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This book presents an introductory survey of computer science. It explores the breadth 
of the subject while including enough depth to convey an honest appreciation for the 
topics involved. 


Audience 

I wrote this text for students of computer science as well as students from other dis- 
ciplines. As for computer science students, most begin their studies with the illusion 
that computer science is programming and Web browsing since that is essentially all 
they have seen. Yet computer science is much more than this. In turn, beginning 
computer science students need exposure to the breadth of the subject in which they 
are planning to major. Providing this exposure is the theme of this book. It gives stu- 
dents an overview of computer science-a foundation from which they can appreci- 
ate the relevance and interrelationships of future courses in the field. This survey 
approach is, in fact, the model used for introductory courses in the natural sciences. 

This broad background is also what students from other disciplines need if they 
are to relate to the technical society in which they live. A computer science course 
for this audience should provide a practical, realistic understanding of the entire field 
rather than merely an introduction to using the Internet or training in the use of 
some popular software packages. There is, of course, a proper place for training, but 
this text is about educating. As the old Chinese proverb says: "Give a man a fish and 
you feed him for a day. Teach a man to fish and you feed him for a lifetime." 

Previous editions of this text have been used successfully in courses for students 
over a wide range of disciplines and educational levels, ranging from high school to 
graduate courses. This edition is designed to continue that tradition. 


New in the Ninth Edition 

The most noteworthy changes reflected in this ninth edition are in Chapter 4 [Net- 
working and the Internet), Chapter 7 (Software Engineering), and Chapter 10 (Artifi- 
cial Intelligence). Although the table of contents for these chapters has changed little, 
the material inside has been expanded, updated, and rearranged significantly. In 
Chapter 4 the coverage of networking fundamentals, XML and HTML, and security 
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has been expanded; Chapter 7 has been overhauled and now includes a more precise 
introduction to UML; and Chapter 10 has been extensively rewritten. 

Less dramatic changes in other chapters include the following: In Chapter 1, a sub- 
section on flash memory devices has been added and the section on data compression 
has been rewritten (LZ77 compression was replaced by LZW and material on com- 
pressing audio and video was added). In Chapter 2, material on USB and FireWire 
has been added. In Chapter 3, the introductory section as well as the section on secu- 
rity has been rewritten. In Chapter 6, the subsection on linking and loading has been 
deleted. In addition, many small changes have been made throughout the text to pro- 
vide clear, up-to-date, and relevant coverage of topics. 


Organization 

This text follows a bottom-up arrangement of subjects that progresses from the con- 
crete to the abstract-an order that results in a sound pedagogical presentation in 
which each topic leads to the next. It begins with the fundamentals of information 
encoding and computer architecture (Chapters 1 and 2), progresses to the study of 
operating systems (Chapter 3) and computer networks (Chapter 4), investigates the 
topics of algorithms, programming languages, and software development (Chapters 5 
through 7), explores issues of data structures and databases (Chapters 8 and 9), con- 
siders future applications of computer technology via artificial intelligence (Chapter 
10), and closes with an introduction to the theory of computation (Chapter 11). 

Although the text follows this natural progression, the individual chapters and 
sections are surprisingly independent and can usually be read as isolated units or 
rearranged to form alternative sequences of study. Indeed, the book is often used as 
a text for courses that cover the material in a variety of orders. One of these alterna- 
tives begins with material from Chapters 5 and 6 (Algorithms and Programming Lan- 
guages) and returns to the earlier chapters as desired. In contrast, I know of one 
course that starts with the material on computability from Chapter 11. In still other 
instances the text has been used in "senior capstone" courses where it serves as a 
backbone from which to branch into projects in different areas. 

On the opening page of each chapter, I have used asterisks to mark some sec- 
tions as optional. These are sections that cover topics of more specific interest or per- 
haps explore traditional topics in more depth. My intention is merely to provide 
suggestions for those looking for alternative paths through the text. There are, of 
course, other shortcuts. In particular, if you are looking for a quick read, I suggest the 
following sequence: 


Section 

Tbpic 

1. 1-1.4 

Basics of data encoding and storage 

2. 1-2.3 

Machine architecture and machine language 

3. 1-3.3 

Operating systems 

4. 1-4.3 

Networking and the Internet 



5. 1- 5.4 

6. 1- 6.4 

7. 1- 7.2 

8 . 1 - 8.2 

9. 1- 9.2 

10.1- 10.3 

11 . 1 - 11.2 


Algorithms and algorithm design 

Programming languages 

Software engineering 

Data abstractions 

Database systems 

Artificial intelligence 

Theory of computation 


There are several themes woven throughout the text. One is that computer sci- 
ence is dynamic. The text repeatedly presents topics in a historical perspective, dis- 
cusses the current state of affairs, and indicates directions of research. Another theme 
is the role of abstraction and the way in which abstract tools are used to control com- 
plexity. This theme is introduced in Chapter 0 and then echoed in the context of oper- 
ating system architecture, algorithm development, programming language design, 
software engineering, data representation, and database systems. 


To Instructor^ 


There is more material in this text than can normally be covered in a single semes- 
ter, so do not hesitate to skip topics that do not fit your course objectives or to rearrange 
the order as you see fit. You will find that, although the text follows a plot, the topics 
are covered in a largely independent manner that allows you to pick and choose as 
you desire. I wrote the book to be used as a course resource — not as a course defini- 
tion. I myself like to cover some topics as reading assignments and to encourage stu- 
dents to read the material not explicitly included in my course. I think we underrate 
students if we assume that we have to explain everything in class. We should be help- 
ing them learn to learn on their own. 

I feel obliged to say a few words about the bottom-up, concrete-to-abstract organ- 
ization of the text. I think as academics we too often assume that students will appre- 
ciate our perspective of a subject-often one that we have developed over many years 
of working in afield. As teachers I think we do better by presenting material from the 
student's perspective. This is why the text starts with data re presentation/storage, 
machine architecture, operating systems, and networking. These are topics to which 
students readily relate-they have most likely heard terms such as JPEG and MP3, 
they have probably recorded data on CDs and DVDs, they have purchased computer 
components, they have interacted with an operating system, and they have used the 
Internet. By starting the course with these topics, I see my students discovering 
answers to many of the "why" questions they have been carrying for years and learn- 
ing to view the course as practical rather than theoretical. From this beginning it is 
natural to move on to the more abstract issues of algorithms, algorithmic structures, 
programming languages, software development methodologies, computability, and 
complexity, which those of us in the field view as the main topics in the science. As 
I've said before, the topics are presented in a manner that does not force you to fol- 
low this sequence, but I encourage you to give it a try. 
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We are all aware that students learn a lot more than we teach them directly, and 
the lessons they learn implicitly are often better absorbed than those that are stud- 
ied explicitly. This is significant when it comes to "teaching" problem solving. Stu- 
dents do not become problem solvers by studying problem-solving methodologies. 
They become problem solvers by solving problems-and notjust carefully posed "text- 
book problems." So I have included numerous problems throughout the text, a few of 
which are intentionally vague-meaning that there is not a single correct answer. I 
encourage you to use these and to expand on them. 

Another topic that I place in this "implicit learning" category is that of profes- 
sionalism, ethics, and social responsibility. I do not believe that this material should 
be presented as an isolated subject. Instead, it should surface when it is relevant, 
which is the approach I have taken in this text. You will find that Sections 3.5, 4.5, 
7.8, 9.7, and 10.7 present such topics as security, privacy, liability, and social aware- 
ness in the context of operating systems, networking, database systems, software 
engineering, and artificial intelligence. Moreover, Section 0.6 introduces this theme 
by summarizing some of the more prominent theories that attempt to place ethical 
decision making on a philosophically firm foundation. You will also find that each 
chapter includes a collection of questions called Social Issues that challenge students 
to think about the relationship between the material in the text and the society in 
which they live. 

Thank you for considering my text for your course. Whether you do or do not 
decide that it is right for your situation, I hope that you find it to be a contribution to 
the computer science education literature. 


Pedagogical Features 

This text is the product of many years of teaching. As a result, it is rich in pedagogi- 
cal aids. Paramount is the abundance of problems to enhance the student's partici- 
pation-over 1,000 in this ninth edition. These are classified as Questions & Exercises, 
Chapter Review Problems, and Social Issues. The Questions & Exercises appear at the 
end of each section (except for the introductory chapter). They review the material 
just discussed, extend the previous discussion, or hint at related topics to be covered 
later. These questions are answered in Appendix F. 

The Chapter Review Problems appear at the end of each chapter (except for the 
introductory chapter). They are designed to serve as "homework" problems in that they 
cover the material from the entire chapter and are not answered in the text. 

Also at the end of each chapter are questions in the Social Issues category. They 
are designed for thought and discussion. Many of them can be used to launch research 
assignments culminating in short written or oral reports. 

Each chapter also ends with a list called Additional Reading that contains references 
to other materials relating to the subject of the chapter. The websites identified in 
this preface, in the text, and in the sidebars of the text are also good places to look for 
related material. 



To Students 



Supplemental Resources 

A variety of supplemental materials for this text are available at the book's compan- 
ion website: www.aw.com/brookshear . The following are accessible to all readers: 

• Chapter-by-chapter activities that extend topics in the text and provide oppor- 
tunities to explore related topics; 

• Software simulators for the example machine used throughout Chapter 2; and 

• Chapter-by-chapter "self tests" that help readers to rethink the material covered 
in the text 

In addition, the following supplements are available to qualified instructors at 
Addison-Wesley's Instructor's Resource Center. Please visit www. aw . com/ire or con- 
tact your Addison-Wesley sales representative for information on how to access them: 

• Instructor's Guide with answers to the Chapter Review Problems; 

• PowerPoint lecture slides; and 

• Test bank 

You may also want to check out my personal website at www. mscs .mu . edu/~glennb. 
It is not very formal (and it is subject to my whims and sense of humor), but I tend to keep 
some information there that you may find helpful. 


To Students 

I'm a bit of a nonconformist (some of my friends would say more than a bit) so when 
I set out to write this text I didn't always follow the advice I received. In particular, 
many argued that certain material was too advanced for beginning students. But I 
believe that if a topic is relevant, then it is relevant even if the academic community 
considers it to be an "advanced topic." You deserve a text that presents a complete 
picture of computer science-not a watered-down version containing artificially sim- 
plified presentations of only those topics that have been deemed appropriate for intro- 
ductory students. Thus, I have not avoided topics. Instead I've sought better 
explanations. I've tried to provide enough depth to give you an honest picture of what 
computer science is all about. As in the case of spices in a recipe, you may choose to 
skip some of the topics in the following pages, but they are there for you to taste if you 
wish-and I encourage you to do so. 

I should also point out that in any course dealing with technology, the details 
you learn today may not be the details you will need to know tomorrow. The field is 
dynamic-that's part of the excitement. This book will give you a current picture of 
the subject as well as a historical perspective. With this background you will be pre- 
pared to grow along with technology. I encourage you to start the growing process now 
by exploring beyond this text. Learn to learn. 

Thank you for the trust you have placed in me by choosing to read my book. As 
an author I have an obligation to produce a manuscript that is worth your time. I 
hope you find that I have lived up to this obligation. 
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Computer science is the discipline that seeks to build a scientific foundation for such top- 
ics as computer design, computer programming, information processing, algorithmic 
solutions of problems, and the algorithmic process itself. It provides the underpinnings 
for today's computer applications as well as the foundations for tomorrow's applications. 

This book provides a comprehensive introduction to this science. We will investi- 
gate a wide range of topics including most of those that constitute a typical university 
computer science curriculum. We want to appreciate the full scope and dynamics of 
the field. Thus, in addition to the topics themselves, we will be interested in their his- 
torical development, the current State of research, and prospects for the future. Our goal 
is to establish a functional understanding of computer science-one that will support 
those who wish to pursue more specialized studies in the science as well as one that 
will enable those in other fields to flourish in an increasingly technical society. 


0.1 The Role of Algorithms 

We begin with the most fundamental concept of computer science-that of an algo- 
rithm. Informally, an algorithm is a set of steps that defines how a task is performed. 
(We will be more precise later in Chapter 5.) For example, there are algorithms for 
cooking (called recipes), for finding your way through a strange city (more commonly 
called directions), for operating washing machines (usually displayed on the inside of 
the washer's lid or perhaps on the wall of a laundromat), for playing music (expressed 
in the form of sheet music), and for performing magic tricks (Figure 0.1). 

Before a machine such as a computer can perform a task, an algorithm for per- 
forming that task must be discovered and represented in a form that is compatible 
with the machine. A representation of an algorithm is called a program. For the con- 
venience of humans, computer programs are usually printed on paper or displayed on 
computer screens. For the convenience of machines, programs are encoded in a man- 
ner compatible with the technology of the machine. The process of developing a pro- 
gram, encoding it in machine-compatible form, and inserting it into a machine is called 
programming. Programs, and the algorithms they represent, are collectively referred 
to as software, in contrast to the machinery itself, which is known as hardware. 

The study of algorithms began as a subject in mathematics. Indeed, the search for 
algorithms was a significant activity of mathematicians long before the development 
of today's computers. The goal was to find a single set of directions that described 
how all problems of a particular type could be solved. One of the best known exam- 
ples of this early research is the long division algorithm for finding the quotient of two 
multiple-digit numbers. Another example is the Euclidean algorithm, discovered by 
the ancient Greek mathematician Euclid, for finding the greatest common divisor of 
two positive integers (Figure 0.2). 

Once an algorithm for performing a task has been found, the performance of that 
task no longer requires an understanding of the principles on which the algorithm is 
based. Instead, the performance of the task is reduced to the process of merely fol- 
lowing directions. (We can follow the long division algorithm to find a quotient or the 
Euclidean algorithm to find a greatest common divisor without understanding why the 
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Figure 0.1 An algorithm fora magic trick 


Effect: The performer places s o m e card s f r o m a normal 
deck of playing cards face down on a table and mixes 
them thoroughly while spreading them out on the table. 
Then, as the audience requests either red or black cards, 
the performer turns over cards of the requested color. 

Secret and Patter: 


Step 1 . 

From a normal deck of cards, select ten red cards 
and ten black cards. Deal these cards face up 
in two piles on the table according to color. 

Step 2. 

Announce that you have selected some red cards 
and some black cards. 

Step 3. 

Pick op the red cards. Under the pretense of aligning 
them into a small deck, hold them face down in your 
left hand and, with the thumb and first finger of your 
right hand, pull back on each end of the deck so that 
each card is given a slightly backward curve . Then 
place the deck of red cards face down on the table 
as you say, "Here are the red cards in this stack." 

Step 4. 

Pick up the black cards. In a manner similar to that 
instep 3, give these cards a slight forward curve. 

Then return these cards to the table in a face-down 
deck as you say, "And here are the black cards in 
this stack." 

Step 5. 

Immediately after returning the black cards to the 
table, use both hands to mix the red and black 
cards (still face down) as you spread them out 
on the tabletop. Explain that you arethoroughy 
mixing the cards. 

Step 6. 

As long as there are face-down cards on the table, 
repeatedly execute the following steps: 

6.1 .Ask the audience to request either a red or a 
black card. 

6.2. Ifthe color requested is red and there is a 
face-down card with a concave appearance, 
turn over such a card while saying, 

"Here is a red card," 

6.3. If the color requested is black and there is a 
face-down card with a convex appearance, 
turn over such a card while saying, 

"Here is a black card." 

6.4. Otherwise, state that there are no more cards 
of the requested color and turn over the 
remaining cards to prove your claim. 
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Figure 0,2 The Euclidean algorithm for finding the greatest common divisor of two positive integers 


Description: This algorithm assumes that 
its input consists of two positive integers 
and proceeds to compute the greatest 
common divisor of these two values. 

Procedure: 

Step 1. Assign M and N the value of the 
larger and smaller of the two 
input values, respectively. 

Step 2. Divide M by N, and call the 
remainder R. 

Step 3. If Ft is not 0, then assign M the 

value of N, assign N the value of R, 
and return to step 2; otherwise, 
the greatest common divisor is 
the value currently assigned to N. 


algorithm works.) In a sense, the intelligence required to solve the problem at hand 
is encoded in the algorithm. 

It is through this ability to capture and convey intelligence (or at least intelligent 
behavior) by means of algorithms that we are able to build machines that perform use- 
ful tasks. Consequently, the level of intelligence displayed by machines is limited by 
the intelligence that can be conveyed through algorithms. We can construct a machine 
to perform a task only if an algorithm exists for performing that task. In turn, if no algo- 
rithm exists for solving a problem, then the solution of that problem lies beyond the 
capabilities of machines. 

Identifying the limitations of algorithmic capabilities solidified as a subject in 
mathematics in the 1930s with the publication of Kurt Godel's incompleteness theo- 
rem. This theorem essentially states that in any mathematical theory encompassing 
our traditional arithmetic system, there are statements whose truth or falseness can- 
not be established by algorithmic means. In short, any complete study of our arith- 
metic system lies beyond the capabilities of algorithmic activities. 

This realization shook the foundations of mathematics, and the study of algorithmic 
capabilities that ensued was the beginning of the field known today as computer science. 
Indeed, it is the study of algorithms that forms the core of computer science. 


0.2 The Origins of Computing Machines 

Today's computers have an extensive genealogy. One of the earlier computing devices 
was the abacus. Its history has been traced as far back as the ancient Greek and Roman 
civilizations. The machine is quite simple, consisting of beads strung on rods that are 
in turn mounted in a rectangular frame (Figure 0.3). As the beads are moved back and 
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Figure 0.3 An abacus (photography by Wayne Chandler) 



forth on the rods, their positions represent stored values. It is in the positions of the 
beads that this "computer" represents and stores data. For control of an algorithm's exe- 
cution, the machine relies on the human operator. Thus the abacus alone is merely 
a data storage system; it must be combined with a human to create a complete com- 
putational machine. 

In more recent years, the design of computing machines was based on the tech- 
nology of gears. Among the inventors were Blaise Pascal (1623-1662) of France, Gott- 
fried Wilhelm Leibniz (1646-1716) of Germany, and Charles Babbage (1792-1871) of 
England. These machines represented data through gear positioning, with data being 
input mechanically by establishing initial gear positions. Output from Pascal's and 
Leibniz's machines was achieved by observing the final gear positions. Babbage, on 
the other hand, envisioned machines that would print results of computations on 
paper so that the possibility of transcription errors would be eliminated. 

As for the ability to follow an algorithm, we can see a progression of flexibility in 
these machines. Pascal's machine was built to perform only addition. Consequently, 
the appropriate sequence of steps was embedded into the structure of the machine 
itself. In a similar manner, Leibniz's machine had its algorithms firmly embedded in its 
architecture, although it offered a variety of arithmetic operations from which the oper- 
ator could select. Babbage's Difference Engine (of which only a demonstration model 
was constructed) could be modified to perform a variety of calculations, but his Ana- 
lytical Engine (the construction for which he never received funding) was designed to 
read instructions in the form of holes in paper cards. Thus Babbage's Analytical Engine 
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Augusta Ada Byron 

Ever since the US Department of Defense named a programming language in her 
honor, Augusta Ada Byron, Countess of Lovelace, has been the subject of much 
commentary in the computing community. Ada Byron lived a somewhat tragic 
life of less than 37 years (1815-1852) that was complicated by poor health and the 
fact that she was a nonconformist in a society that limited the professional role of 
women. She became fascinated by the machines of Charles Babbage when she 
witnessed a demonstration of a prototype of his Difference Engine in 1333. Her 
contribution to computer science involved her translation from French into Eng- 
lish of a paper discussing Babbage's designs for the Analytical Engine. Tb this 
translation, Babbage encouraged her to attach an addendum describing applica- 
tions of the engine and containing examples of how the engine could be pro- 
grammed to perform various tasks. Babbage's enthusiasm for Ada Byron's work 
was motivated by his hope that its publication would lead to financial backing for 
the construction of his Analytical Engine. (As the daughter of Lord Byron, Ada 
Byron held celebrity status with potentially significant financial connections.) 
This backing never materialized, but Ada Byron's addendum has survived and is 
considered to contain the first examples of computer programs. Thus, Augusta 
Ada Byron is recognized today as the world's first programmer. 


was programmable. In fact, Augusta Ada Byron (Ada Lovelace), who published a paper 
in which she demonstrated how Babbage's Analytical Engine could be programmed to 
perform various computations, is often identified today as the world's first programmer. 

The idea of communicating an algorithm via holes in paper was not originated by 
Babbage. He got the idea from Joseph Jacquard (1752-1834), who, in 1801, had devel- 
oped a weaving loom in which the steps to be performed during the weaving process 
were determined by patterns of holes in paper cards. In this manner, the algorithm 
followed by the loom could be changed easily to produce different woven designs. 
Another beneficiary of Jacquard's idea was Herman Hollerith (1860-1929), who 
applied the concept of representing information as holes in paper cards to speed up 
the tabulation process in the 1890 U.S. census. (It was this work by Hollerith that led 
to the creation of IBM.) Such cards ultimately came to be known as punched cards and 
survived as a popular means of communicating with computers well into the 1970s. 
Indeed, the technique lives on today, as witnessed by the voting issues raised in the 
2000 U.S. presidential election. 

The technology of the time was unable to produce the complex gear-driven 
machines of Pascal, Leibniz, and Babbage in a financially feasible manner. But with 
the advances in electronics in the early 1900s, this barrier was overcome. Examples 
of this progress include the electromechanical machine of George Stibitz, completed 
in 1940 at Bell Laboratories, and the Mark 1, completed in 1944 at Harvard University 
by Howard Aiken and a group of IBM engineers (Figure 0.4). These machines made 
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Figure 0.4 The Mark I computer 



heavy use of electronically controlled mechanical relays. In this sense they were obso- 
lete almost as soon as they were built, because other researchers were applying the 
technology of vacuum tubes to construct totally electronic computers. The first of 
these machines was apparently the Atanasoff-Berry machine, constructed during the 
period from 1937 to 1941 at Iowa State College (now Iowa State University) by John 
Atanasoff and his assistant, Clifford Berry. Another was a machine called Colossus, 
built under the direction of Tommy Flowers in England to decode German messages 
during the latter part of World War II. (Actually, as many as ten of these machines were 
apparently built, but military secrecy and issues of national security kept their exis- 
tence from becoming part of the "computer family tree.') Other, more flexible 
machines, such as the ENIAC (electronic numerical integrator and calculator) devel- 
oped by John Mauchly and J. Presper Eckert at the Moore School of Electrical Engi- 
neering, University of Pennsylvania, soon followed. 

From that point on, the history of computing machines is been closely linked to 
advancing technology, including the invention of transistors and the subsequent devel- 
opment of integrated circuits, the establishment of communication satellites, and 
advances in optic technology. Today, small hand-held computers have more com- 
puting power than the room-size machines of the 1940s and can exchange informa- 
tion quickly via global communication systems. 

A major step toward popularizing computing was the development of desktop com- 
puters. The origins of these machines can be traced to the computer hobbyists who 
began to experiment with homemade computers shortly after the development of the 
large research machines of the 1940s. It was within this "underground" of hobby activ- 
ity that Steve Jobs and Stephen Wozniak built a commercially viable home computer 
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Babbage's Difference Engine 

The machines designed by Charles Babbage were truly the forerunners of mod- 
ern computer design. If technology been able to produce his machines in an 
economically feasible manner and if the data processing demands of commerce 
and government been on the scale of today's requirements, Babbage's ideas 
could have led to the computer revolution in the 1800s. As it was, only a 
demonstration model of his Difference Engine was constructed in his lifetime. 
This machine determined numerical values by computing "successive differ- 
ences." We can gain an insight to this technique by considering the problem of 
computing the squares of the integers. We begin with the knowledge that the 
square ofOisO, the square of 1 is 1, the square of 2 is 4, and the square of 3 is 9. 
With this, we can determine the square of 4 in the following manner (see the 
diagram below). We first compute the differences of the squares we already 
know: V - 0 2 = 1, 2 2 - I - 3, and 3 2 - 2 2 = 5. Then we compute the differ- 
ences of these results: 3-1 =2, and 5-3 = 2. Note that these differences are 
both 2. Assuming that this consistency continues (mathematics can show that it 
does) we conclude that the difference between the value (4 2 - 3 2 ) and the value 
(3 2 - 2 2 ) must also be 2. Hence (4 2 - 3 2 ) must be 2 greater than (3 2 - 2 2 ), so 4 2 - 
3 2 = 7andthus 4 2 = 3 2 + 7 = 16. Now that we know the square of 4, we could 
continue our procedure to compute the square of 5 based on the values of l 2 , 

2\ 3\ and A 2 . (Although a more in-depth discussion of successive differences is 
beyond the scope of our current study, students of calculus may wish to 
observe that the preceding example is based on the fact that the derivative of 
y = x 2 is a straight line with a slope of 2.) 
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and, in 1976, established Apple Computer, Inc., to manufacture and market their prod- 
ucts. Other companies that marketed similar products were Commodore, Heathkit, and 
Radio Shack. Although these products were popular among computer hobbyists, they 
were not widely accepted by the business community, which continued to look to the 
well-established IBM for the majority of its computing needs. 

In 1981, IBM introduced its first desktop computer, called the personal computer, 
or PC, whose underlying software was developed by a struggling young company known 
as Microsoft. The PC was an instant success and legitimized the desktop computer as 
an established commodity in the minds of the business community. Tbday, the term 
PC is widely used to refer to all those machines (from various manufacturers) whose 
design has evolved from IBM's initial desktop computer, most of which continue to be 
marketed with software from Microsoft. At times, however, the term PC is used inter- 
changeably with the generic terms desktop or laptop. 

The miniaturization of computers and their expanding capabilities have brought 
computer technology to the forefront of today's society. Computer technology is so 
prevalent now that familiarity with it is fundamental to being a member of modern soci- 
ety. Home computers are becoming integrated with entertainment and communica- 
tion systems. Cellular telephones and digital cameras are now combined with computer 
technology in single hand-held units called personal digital assistants (PDAs). 

On a broader scale computing technology has altered the ability of governments 
to control their citizens, has had enormous impact on global economics, has led to star- 
tling advances in scientific research, and has repeatedly challenged society's status 
quo. One can hardly imagine what the future will bring. 


0.3 The Science of Algorithms 

Conditions such as limited data storage capabilities and intricate, time-consuming 
programming procedures restricted the complexity of the algorithms utilized in early 
computing machines. However, as these limitations began to disappear, machines 
were applied to increasingly larger and more complex tasks. As attempts to express 
the composition of these tasks in algorithmic form began to tax the abilities of the 
human mind, more and more research efforts were directed toward the study of algo- 
rithms and the programming process. 

It was in this context that the theoretical work of mathematicians began to pay 
dividends. As a consequence of Godel's incompleteness theorem, mathematicians 
had already been investigating those questions regarding algorithmic processes that 
advancing technology was now raising. With that, the stage was set for the emergence 
of a new discipline known as computer science. 

Today, computer science has established itself as the science of algorithms. 
The scope of this science is broad, drawing from such diverse subjects as mathe- 
matics, engineering, psychology, biology, business administration, and linguistics. 
In the chapters that follow, we will discuss many of the topics of this science. In 



Figure 0.5 The central role of algorithms in computer science 



each case, our goal will be to introduce the central ideas in the subject, the current 
topics of research, and some of the techniques being applied to advance knowl- 
edge in the area. 

As we progress through our study, it is easy to lose track of the overall picture. 
We therefore pause to collect our thoughts by identifying some questions that define 
the science of computing and provide the focus for its study. 

• Which problems can be solved by algorithmic processes? 

• How can the discovery of algorithms be made easier? 

• How can the techniques of representing and communicating algorithms be 
improved? 

• How can our knowledge of algorithms and technology be applied to provide 
better machines? 

• How can the characteristics of different algorithms be analyzed and compared? 

Note that the theme common to all these questions is the study of algorithms 
(Figure 0.5). 


0.4 Abstraction 

The concept of abstraction so permeates the study of computer science and the design 
of computer systems that it behooves us to address it in this preliminary chapter. The 
term abstraction, as we are using it here, refers to the distinction between the exter- 
nal properties of an entity and the details of the entity's internal composition. It is 
abstraction that allows us to ignore the internal details of a complex device such as a 
computer, automobile, or microwave oven and use it as a single, comprehensible unit. 
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Moreover, it is by means of abstraction that such complex systems are designed and 
manufactured in the first place. Computers, automobiles, and microwave ovens are 
constructed from components, each of which is constructed from smaller compo- 
nents. Each component represents a level of abstraction at which the use of the com- 
ponent is isolated from the details of the component's internal composition. 

It is by applying abstraction, then, that we are able to construct, analyze, and 
manage large, complex computer systems, which would be overwhelming if viewed 
in their entirety at a detailed level. At each level of abstraction, we view the system 
in terms of components, called abstract tools, whose internal composition we ignore. 
This allows us to concentrate on how each component interacts with other compo- 
nents at the same level and how the collection as a whole forms a higher-level com- 
ponent. Thus we are able to comprehend the part of the system that is relevant to the 
task at hand rather than being lost in a sea of details. 

We emphasize that abstraction is not limited to science and technology. It is an 
important simplification technique with which our society has created a lifestyle that 
would otherwise be impossible. Few of us understand how the various conveniences 
of daily life are actually implemented. We eat food and wear clothes that we cannot pro- 
duce by ourselves. We use electrical devices without understanding the underlying 
technology. We use the services of others without knowing the details of their profes- 
sions. With each new advancement, a small part of society chooses to specialize in its 
implementation while the rest of us learn to use the results as abstract tools. In this man- 
ner, society's warehouse of abstract tools expands, and society's ability to advance fur- 
ther increases. 

Abstraction is a recurring theme in our study. We will learn that computing equip- 
ment is constructed in levels of abstract tools. We will also see that the development 
of large software systems is accomplished in a modular fashion in which each mod- 
ule is used as an abstract tool in larger modules. Moreover, abstraction plays an impor- 
tant role in the task of advancing computer science itself, allowing researchers to 
focus attention on particular areas within a complex field. In fact, the organization of 
this text reflects this characteristic of the science. Each chapter, which focuses on a 
particular area within the science, is often surprisingly independent of the others, 
yet together the chapters form a comprehensive overview of a vast field of study. 


0.5 An Outline of Our Study 

This text follows a bottom up approach to the study of computer science, beginning with 
such hands-on topics as computer hardware and leading to the more abstract topics such 
as algorithm complexity and computability. The result is that our study follows a pattern 
of building larger and larger abstract tools as our understanding of the subject expands. 

We begin by considering topics dealing with the design and construction of 
machines for executing algorithms. In Chapter 1 (Data Storage) we look at how infor- 
mation is encoded and stored within modern computers, and in Chapter 2 (Data Manip- 
ulation) we investigate the basic internal operation of a simple computer. Although 
part of this study involves technology, the general theme is technology independent. 
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That is, such topics as digital circuit design, data encoding and compression systems, 
and computer architecture are relevant over a wide range of technology and promise 
to remain relevant regardless of the direction of future technology. 

In Chapter 3 (Operating Systems) we study the software that controls the overall 
operation of a computer. This software is called an operating system. It is a com- 
puter's operating system that controls the interface between the machine and its out- 
side world, protecting the machine and the data stored within from unauthorized 
access, allowing a computer user to request the execution of various programs, and 
coordinating the internal activities required to fulfill the user's requests. 

In Chapter 4 (Networking and the Internet) we study how computers are connected 
to each other to form computer networks and how networks are connected to form 
internets. This study leads to topics such as network protocols, the Internet's structure 
and internal operation, the World Wide Web, and numerous issues of security. 

Chapter 5 (Algorithms) introduces the study of algorithms from a more formal per- 
spective. We investigate how algorithms are discovered, identify several fundamen- 
tal algorithmic structures, develop elementary techniques for representing algorithms, 
and introduce the subjects of algorithm efficiency and correctness. 

In Chapter 6 (Programming Languages) we consider the subject of algorithm rep- 
resentation and the program development process. Here we find that the search for bet- 
ter programming techniques has led to a variety of programming methodologies or 
paradigms, each with its own set of programming languages. We investigate these par- 
adigms and languages as well as consider issues of grammar and language translation. 

Chapter 7 (Software Engineering) introduces the branch of computer science known 
as software engineering, which deals with the problems encountered when developing 
large software systems. The underlying theme is that the design of large software sys- 
tems is a complex task that embraces problems beyond those of traditional engineer- 
ing. Thus, the subject of software engineering has become an important field of research 
within computer science, drawing from such diverse fields as engineering, project man- 
agement, personnel management, programming language design, and even architecture. 

In next two chapters we look at ways data can be organized within a computer sys- 
tem. In Chapter 8 (Data Abstractions) we introduce techniques traditionally used for 
organizing data in a computer's main memory and then trace the evolution of data 
abstraction from the concept of primitives to today's object-oriented techniques. In 
Chapter 9 (Database Systems) we consider methods traditionally used for organizing 
data in a computer's mass storage and investigate how extremely large and complex 
database systems are implemented. 

In Chapter 10 (Artificial Intelligence) we learn that in order to develop more useful 
machines computer science has turned to the study of human intelligence for leadership. 
The hope is that by understanding how our own minds reason and perceive, we will be 
able to design algorithms that mimic these processes and thus transfer these capabilities 
to machines. The result is the area of computer science known as artificial intelligence, 
which leans heavily on research in such areas as psychology, biology, and linguistics. 

Having stretched our imagination with the developments in artificial intelli- 
gence, we investigate the limitations of algorithms (and thus machines) in Chapter 
11 (Theory of Computation). Here we identify some problems that cannot be solved 
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algorithmically (and therefore lie beyond the capabilities of machines) as well as 
learn that the solutions to many other problems require such enormous time or 
space that they are also unsolvable from a practical perspective. Thus, it is through 
this study that we are able to grasp the scope and limitations of algorithmic systems. 

In each chapter our goal is to explore to a depth that leads to a true understand- 
ing of the subject. We want to develop a working knowledge of computer science-a 
knowledge that will allow you to understand the technical society in which you live 
and to provide a foundation from which you can learn on your own as science and 
technology advance. 


0.6 Social Repercussions 

Progress in computer science is blurring many distinctions on which our society has 
based decisions in the past and is challenging many of society's long-held principles. 
In law, it generates questions regarding the degree to which intellectual property can 
be owned and the rights and liabilities that accompany that ownership. In ethics, it 
generates numerous options that challenge the traditional principles on which social 
behavior is based. In government, it generates debates regarding the extent to which 
computer technology and its applications should be regulated. In philosophy, it gen- 
erates contention between the presence of intelligent behavior and the presence of 
intelligence itself. And, throughout society, it generates disputes concerning whether 
new applications represent new freedoms or new controls. 

Although not a part of computer science itself, such topics are important for those 
contemplating careers in computing or computer-related fields. Revelations within 
science have sometimes found controversial applications, causing serious discontent 
for the researchers involved. Moreover, an otherwise successful career can quickly be 
derailed by an ethical misstep. 

The ability to deal with the dilemmas posed by advancing computer technology 
is also important for those outside its immediate realm. Indeed, technology is infil- 
trating society so rapidly that few, if any, are independent of its effects. 

This text provides the technical background needed to approach the dilemmas 
generated by computer science in a rational manner. However, technical knowledge 
of the science alone does not provide solutions to all the questions involved. With 
this in mind, this text includes several sections that are devoted to social, ethical, and 
legal issues. These include security concerns, issues of software ownership and lia- 
bility, the social impact of database technology, and the consequences of advances in 
artificial intelligence. 

Moreover, there is often no single correct answer to a problem, and many valid solu- 
tions are compromises between opposing (and perhaps equally valid) views. Finding 
solutions in these cases often requires the ability to listen, to recognize other points of 
view, to carry on a rational debate, and to alter one's own opinion as new insights are 
gained. Thus, each chapter of this text ends with a collection of questions under the 
heading Social Issues that investigate the relationship between computer science and 
society. These are not necessarily questions to be answered. Instead, they are questions 
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to be considered. In many cases, an answer that may appear obvious at first will cease 
to satisfy you as you explore alternatives. 

To help you find such alternatives, we close this section by introducing some of 
the approaches to ethics that have been proposed by philosophers in their search for 
fundamental theories which lead to principles for guiding decisions and behavior. 
Most of these theories can be classified under the headings of consequence-based 
ethics, duty-based ethics, contract-based ethics, and character-based ethics. 

Consequence-based ethics attempts to analyze issues based on the consequences 
of the various options. A leading example is utilitarianism that proposes that the "cor- 
rect" decision or action is the one that leads to the greatest good for the largest portion 
of society. At first glance utilitarianism appears to be a fair way of resolving ethical 
dilemmas. But, in its unqualified form, utilitarianism leads to numerous unacceptable 
conclusions. For example, it would allow the majority of a society to enslave a small 
minority. Moreover, many argue that consequence-based approaches to ethical theo- 
ries, which inherently emphasize consequences, tend to view a human as merely a 
means to an end rather than as a worthwhile individual. This, they continue, consti- 
tutes a fundamental flaw in all consequence-based ethical theories. 

In contrast to consequence-based ethics, duty-based ethics does not consider the 
consequences of decisions and actions but instead proposes that members of a soci- 
ety have certain intrinsic duties or obligations that in turn form the foundation on 
which ethical questions should be resolved. For example, if one accepts the obligation 
to respect the rights of others, then one must reject slavery regardless of its conse- 
quences. On the other hand, opponents of duty-based ethics argue that it fails to pro- 
vide solutions to problems involving conflicting duties. Should you tell the truth even 
if doing so destroys a colleague's confidence? Should a nation defend itself in war 
even though the ensuing battles will lead to the death of many of its citizens? 

Contract-based ethical theory begins by imagining society with no ethical foun- 
dation at all. In this "state of nature" setting, anything goes-a situation in which indi- 
viduals must fend for themselves and constantly be on guard against aggression from 
others. Under these circumstances, contract-based ethical theory proposes that the 
members of the society would develop "contracts" among themselves. For example, I 
won't steal from you if you won't steal from me. In turn, these "contracts" would 
become the foundation for determining ethical behavior. Note that contract-based 
ethical theory provides a motivation for ethical behavior- we should obey the "con- 
tracts of ethics" because we would otherwise live an unpleasant life. However, oppo- 
nents of contract-based ethical theory argue that it does not provide a broad enough 
basis for resolving ethical dilemmas since it provides guidance only in those cases in 
which contracts have been established. (I can behave anyway I want in situations not 
covered by an existing contract.) In particular, new technologies may present 
uncharted territory in which existing ethical contracts may not apply. 

Character-based ethics (sometimes called virtue ethics), which was promoted by 
Plato and Aristotle, argues that "good behavior" is not the result of applying identifi- 
able rules but instead is a natural consequence of "good character." Whereas conse- 
quence-based ethics, duty-based ethics, and contract-based ethics propose that a person 
resolve an ethical dilemma by asking, "What are the consequences?," "What are my 
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duties?," or "What contracts do I have?," character-based ethics proposes that dilem- 
mas be resolved by asking "Who do I want to be?" Thus, good behavior is obtained by 
building good character, which is typically the result of sound upbringing and the 
development of virtuous habits. 

It is character-based ethics that underlies the approach normally taken when 
teaching ethics to professionals in various fields. Rather than teaching specific ethi- 
cal theories, the approach is to present case studies that expose a variety of ethical 
questions in the professionals' area of expertise. Then, by discussing the pros and 
cons in these cases, the professionals become more aware, insightful, and sensitive 
to the perils lurking in their professional lives and thus grow in character. This is the 
spirit in which the questions regarding social issues at the end of each chapter are pre- 
sented. However, to help you uncover the nuances of each scenario, you might con- 
sider each in the context of the various ethical theories we have discussed. For 
example, do you obtain a different conclusion when applying consequence-based 
ethics than when applying duty-based ethics? Perhaps considering a combination of 
theories will lead to better solutions. In any case, you should strive to find a solution 
with which you are comfortable and that you could defend in a rational debate. 


Social Issues 


The following questions are intended as a guide to the ethical/social/legal issues asso- 
ciated with the field of computing. The goal is not merely to answer these questions. 
You should also consider why you answered as you did and whether your justifications 
are consistent from one question to the next. 

1 . The premise that our society is different from what it would have been with- 
out the computer revolution is generally accepted. Is our society better than it 
would have been without the revolution? Is our society worse? Would your 
answer differ if your position within society were different? 

2 . is it acceptable to participate in today's technical society without making an 
effort to understand the basics of that technology? For instance, do members 
of a democracy, whose votes often determine how technology will be sup- 
ported and used, have an obligation to try to understand that technology? 

Docs your answer depend on which technology is being considered? For 
example, is your answer the same when considering nuclear technology as 
when considering computer technology? 

3 . By using cash in financial transactions, individuals have traditionally had the 
option to manage their financial affairs without service charges. However, as 
more of our economy is becoming automated, financial institutions are imple- 
menting service charges for access to these automated systems. Is there a 
point at which these charges unfairly restrict an individual's access to the 
economy? For example, suppose an employer pays employees only by check. 


32 


I introduction 


and all financial institutions were to place a service charge on check cashing 
and depositing. Would the employees be unfairly treated? What if an 
employer insists on paying only via direct deposit? 

4 . In the context of interactive television, to what extent should a company be 
allowed to retrieve information from children (perhaps via an interactive game 
format)? For example, should a company be allowed to obtain a child's report 
on his or her parents' buying patterns? What about information about the child? 

5 . To what extent should a government regulate computer technology and its 
applications? Consider, for example, the issues mentioned in Questions 3 and 
4. What justifies governmental regulation? 

6. To what extent will our decisions regarding technology in general, and com- 
puter technology in particular, affect future generations? 

7 . As technology advances, our educational system is constantly challenged to 
reconsider the level of abstraction at which topics are presented. Many ques- 
tions take the form of whether a skill is still necessary or whether students 
should be allowed to rely on an abstract tool. Students of trigonometry are no 
longer taught how to find the values of trigonometric functions using tables. 
Instead, they use calculators as abstract tools to find these values. Some argue 
that long division should also give way to abstraction. What other subjects are 
involved with similar controversies? Do modern word processors eliminate 
the need to develop spelling skills? Will the use of video technology someday 
remove the need to read? 

6. The concept of public libraries is largely based on the premise that all citizens 
in a democracy must have access to information. As more information is 
stored and disseminated via computer technology, does access to this technol- 
ogy become a right of every individual? If so, should public libraries be the 
channel by which this access is provided? 

9 . What ethical concerns arise in a society that relies on the use of abstract 

tools? Are there cases in which it is unethical to use a product or service with- 
out understanding how it works? Without knowing how it is produced? Or, 
without understanding the byproducts of its use? 

1 0 . As our economy becomes more automated, it becomes easier for govern- 
ments to monitor their citizens' financial activities. Is that good or bad? 

1 1 .Which technologies that were imagined by George Orwell (Eric Blair) in his 
novel 1984 have actually become reality? Are they being used in the manner 
in which Orwell predicted? 

12. If you had a time machine, in which period of history would you like to live? 
Are there current technologies that you would like to take with you? Could 
your choice of technologies be taken with you without taking others? To what 
extent can one technology be separated from another? Is it consistent to 
protest against global warming yet accept modern medical treatment? 

13. On the basis of your initial answers to the preceding questions, to which ethical 
theory presented in Section 0.6 do you tend to subscribe? 
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In this chapter, we consider topics associ- 
ated with data representation and the 
storage of data within a computer. The 
types of data we will consider include 
text, numeric values, images, audio, and 
video. Much of the information in this 
chapter is also relevant to fields other 
than traditional computing, such as digi- 
tal photography, audio/video recording 
and reproduction, and long distance 
communication. 


1.1 Sits and Their Storage 

Boolean Operations 
Gates and Flip-Flops 
Hexadecimal Notation 

1.2 Main Memory 

Memory Organization 
Measuring Memory Capacity 

1.3 Mass Stofage 

Magnetic Systems 
Optical Systems 
Flash Drives 

File Storage and Retrieval 

1.4 Representing information as Bit 
Patterns 

Representing Text 
Representing Numeric Values 
Representing Images 
Representing Sound 

*1.5 The Binary System 

Binary Notation 
Binary Addition 
Fractions in Binary 

* 1.6 Storing iHitegeTs 

Two's Complement Notation 
Excess Notation 

"1.7 Storing Fractions 

Floating-Point Notation 
Truncation Errors 

*1.8 Data Compression 

Ceneric Data Compression Techniques 
Compressing Images 
Compressing Audio and Video 

*1.9 Communication Errors 

Parity Bits 

Error-Correcting Codes 

* Asterisks indicate suggestions for 
optional sections. 
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Data Storage 


We begin our study by considering how information is encoded and stored inside com- 
puters. Such knowledge is fundamental to understanding many of the issues encountered 
by computer users. Our first step is to discuss the basics of a computer's data storage 
devices and then to consider how information is encoded for storage in these systems. 
We will explore the ramifications of today's data storage systems and how such tech- 
niques as data compression and error handling are used to overcome their shortfalls. 


1.1 Bits and Their Storage 

Inside today's computers information is encoded as patterns of Os and is. These digits 
are called bits (short for binary digits). Although you may be inclined to associate bits 
with numeric values, they are really only symbols whose meaning depends on the 
application at hand. Sometimes patterns ofbits are used to represent numeric values; 
sometimes they represent other symbols such as characters in an alphabet and punc- 
tuation marks; sometimes they represent images; and sometimes they represent sounds. 

Boolean Operations 

To understand how individual bits are stored and manipulated inside a computer, it 
is convenient to imagine that the bit 0 represents the valu q false and the bit 1 repre- 
sents the value true because that allows us to think of manipulating bits as manipu- 
lating true/false values. Operations that manipulate true/false values are called 
Boolean operations, in honor of the mathematician George Boole (1815-1864), who 
was a pioneer in the field of mathematics called logic. Three of the basic Boolean 
operations are AND , OR, and XOR (exclusive or) as summarized in Figure 1.1. These 
operations are similar to the arithmetic operations TIMES and PLUS because they 
combine a pair of values (the operation's input) to produce a third value (the opera- 
tion's output). In contrast to arithmetic operations, however, the only digits manipu- 
lated by the AND, OR, and XOR operations are 0 and 1. 

The Boolean operation AND is designed to reflect the truth or falseness of a state- 
ment formed by combining two smaller, or simpler, statements with the conjunction 
and. Such statements have the generic form 

P AND a 

where P represents one statement and Q_ represents another-for example, 

Kermit is a frog AND Miss Piggy is an actress. 

The inputs to the AND operation represent the truth or falseness of the compound 
statement's components; the output represents the truth or falseness of the com- 
pound statement itself. Since a statement of the form LAND Q_ is true only when 
both of its components are true, we conclude that 1 AND 1 should be 1, whereas all 
other cases should produce an output ofO, in agreement with Figure 1.1. 

In a similar manner, the OR operation is based on compound statements of the form 


P OR Q 
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Figure 1.1 The Boolean operations AND, OR, and XOR (exclusive or) 
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where, again, P represents one statement and Q represents another Such statements 
are true when at least one of their components is true, which agrees with the OR 
operation depicted in Figure 1.1. 

There is not a single conjunction in the English language that captures the 
meaning of the XOR operation. XOR produces an output of 1 (true) when one of its 
inputs is 1 (true) and the other is 0 (false). For example, a statement of the form F 
XOR Q means "either P or Qbut not both." (In short, the XOR operation produces 
an output of 1 when its inputs are different.) 

The operation NOT is another Boolean operation. It differs from AND, OR, and 
XOR because it has only one input. Its output is the opposite of that input; if the input 
of the operation NOT is true, then the output is false, and vice versa. Thus, if the 
input of the NOT operation is the truth or falseness of the statement 

Fozzie is a bear. 

then the output would represent the truth or falseness of the statement 
Fozzie is not a bear. 


Gates and Flip-Flops 

A device that produces the output of a Boolean operation when given the operation's 
input values is called a gate. Gates can be constructed from a variety of technologies such 
as gears, relays, and optic devices. Inside today's computers, gates are usually imple- 
mented as small electronic circuits in which the digits 0 and 1 are represented as volt- 
age levels. We need not concern ourselves with such details, however. For our purposes. 
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1.2 A pictorial representation of AND, OR, XOR, and NOT gates 
as well as their input and output values 
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1.3 A simple flip-flop circuit 
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it suffices to represent gates in their symbolic form, as shown in Figure 1.2. Note that 
the AND, OR, XOR, and NOT gates are represented by distinctively shaped diagrams, 
with the input values entering on one side and the output exiting on the other. 

Gates such as these provide the building blocks from which computers are con- 
structed. One important step in this direction is depicted in the circuit in Figure 1.3. This 
is a particular example from a collection of circuits known as flip-flops. A flip-flop is a 
circuit that produces an output value of 0 or 1, which remains constant until a tempo- 
rary pulse from another circuit causes it to shift to the other value. In other words, the 
output will flip or flop between two values under control of external stimuli. As long as 
both inputs in the circuit in Figure 1.3 remain 0, the output (whether 0 or 1) will not 
change. However, temporarily placing a 1 on the upper input will force the output to 
be 1, whereas temporarily placing a 1 on the lower input will force the output to be 0. 

Let us consider this claim in more detail. Without knowing the current output 
of the circuit in Figure 1.3, suppose that the upper input is changed to 1 while the 
lower input remains 0 (Figure 1.4a). This will cause the output of the OR gate to be 


Figure 1.4 Setting the output of a flip-flop to 1 


a. 1 is placed on the upper input. b. This causes the output of the OR gate to be 1 and, 

in turn, the output of the AND gate to be 1. 




c. The 1 from the AND gate keeps the OR gate from 
changing after the upper input returns to 0. 
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1, regardless of the other inptit to this gate. In turn, both inputs to the AND gate will 
now be 1, since the other input to this gate is already 1 (obtained by passing the 
lower input of the flip-flop through the NOT gate). The output of the AND gate will 
then become 1, which means that the second input to the OR gate will now be 1 
(Figure 1.4b). This guarantees that the output of the OR gate will remain 1, even 
when the upper input to the flip-flop is changed back to 0 (Figure 1.4c). In summary, 
the flip-flop's output has become 1, and this output value will remain after the upper 
input returns to 0. 

In a similar manner, temporarily placing the value 1 on the lower input will 
force the flip-flop's output to be 0, and this output will persist after the input value 
returns to 0. 

Our purpose in introducing the flip-flop circuit in Figures 1.3 and 1.4 is twofold. 
First, it demonstrates how devices can be constructed from gates, a process known 
as digital circuit design, which is an important topic in computer engineering. Indeed, 
the flip-flop is only one of many circuits that are basic tools in computer engineering. 
Moreover, there are Other ways to build a flip-flop. One alternative is shown in Fig- 
ure 1.5. If you experiment with this circuit, you will find that, although it has a dif- 
ferent internal structure, its external properties are the same as those of Figure 1.3. 
This leads us to our first example of the role of abstract tools. When designing a flip- 
flop, a computer engineer considers the alternative ways in which a flip-flop can be 
constructed using gates as building blocks. Then, once flip-flops and other basic cir- 
cuits have been designed, the engineer can use those circuits as building blocks to 
construct more complex circuitry. In turn, the design of computer circuitry takes on 
a hierarchical structure, each level of which uses the lower level components as 
abstract tools. 

The second purpose for introducing the flip-flop is that it is one means of storing 
a bit within a computer. Indeed, a flip-flop can be set to have the output value of 
either 0 or 1. Other circuits can easily adjust this value by sending pulses to the flip- 
flop's inputs, and still other circuits can respond to the stored value by using the flip- 
flop's output as their inputs. By applying current technology, many flip-flops can be 


Figure 1.5 Another way of constructing a flip-flop 
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constructed on a single wafer (called a chip) and used inside a computer as a means 
of recording information that is encoded as patterns of Os and i s. 

Hexadecimal Notation 

When considering the internal activities of a computer, we must deal with strings of 
bits, some of which can be quite long. A long string of bits is often called a stream. 
Unfortunately, streams are difficult for the human mind to comprehend. Merely tran- 
scribing the pattern 101101010011 is tedious and error prone. To simplify the repre- 
sentation of such bit patterns, therefore, we usually use a shorthand notation called 
hexadecimal notation, which takes advantage of the fact that bit patterns within a 
machine tend to have lengths in multiples of four. In particular, hexadecimal notation 
uses a single symbol to represent a pattern of four bits, meaning that a string of twelve 
bits can be represented by only three symbols. 

Figure 1.6 presents the hexadecimal encoding system. The left column displays 
all possible bit patterns of length four; the right column shows the symbol used in hexa- 
decimal notation to represent the bit pattern to its left. Using this system, the bit pat- 
tern 10110101 is represented as B5. This is obtained by dividing the bit pattern into 
substrings of length four and then representing each substring by its hexadecimal 
equivalent- 101 1 is represented by B, and 0101 is represented by 5. In this manner, the 
16-bit pattern 1010010011001000 can be reduced to the more palatable form A4C8. 

We will use hexadecimal notation extensively in the next chapter. There you will 
come to appreciate its efficiency. 


Figure 1.6 The hexadecimal encoding system 
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Questions 
& Exercises 


1 . What input bit patterns will cause the following circuit to produce an output 
of 1? 


Inputs 


> 


o* 


Output 


2 In the text, we claimed that placing a 1 on the lower input of the flip-flop in 
Figure 1.3 (while holding the upper input at 0) will force the flip-flop's out- 
put to be 0. Describe the sequence of events that occurs within the flip-flop 
in this case. 

3. Assuming that both inputs to the flip-ffll<D>|p m Figure 1.5 are 0, describe tthe 
sequence of events that occurs when the upper input is temporarily set to 1. 

4. It is often necessary to coordinate the activities of WM*ii<Q>iUS 

within a computer. This is accomplished by connecting a pulsating signal 
(called a clock ) to those circuits that require coordination. As the clock alter- 
nates between the values 0 and 1, it activates the various circuit compo- 
nents. Below is an example of one part of such a circuit that involves the 
flip-flop shown in Figure 1.3. For what clock values will the flip-flop be 
shielded from the effects of the circuit's input values? For what clock values 
will the flip-flop respond to the circuit's input values? 



5. a. If the output of an OR gate is passed through a NOT gate, the combination 
computes the Boolean operation called NOR that has an output of 1 only 
when both its inputs are 0. The symbol for a NOR gate is the same as an 
OR gate except that it has a circle at its output. Below is a circuit contain- 
ing an AND gate and two NOR gates. What Boolean operation does the 
circuit compute? 
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b. If the output of an AND gate is passed through a NOT gate, the combina- 
tion computes the Boolean operation called NAND, which has an output 
of 0 only when both its inputs are 1. The symbol for a NAND gate is the 
same as an AND gate except that it has a circle at its output. Below is a 
circuit containing NAND gates. What Boolean operation does the circuit 
compute? 


Input >■ 


Input > 



Output 


6. Use hexadecimal notation to represent the following bit patterns: 

a. 0110101011110010 b. 111010000101010100010111 c. 01001000 

7 . What bit patterns are represented by the following hexadecimal patterns? 

a. 5FD97 b. 610A c. ABCD d. 0100 

1.2 Main Memory 

For the purpose of storing data, a computer contains a large collection of circuits (such 
as flip-flops), each capable of storing a single bit. This bit reservoir is known as the 
machine's main memory. 


Memory Organization 

A computer's main memory is organized in manageable units called cells, with a 
typical cell size being eight bits. (A string of eight bits is called a byte. Thus, a typi- 
cal memory cell has a capacity of one byte.) Small computers used in such house- 
hold devices as microwave ovens may have main memories consisting of only a few 
hundred cells, whereas large computers may have billions of cells in their main 
memories. 

Although there is no left or right within a computer, we normally envision the 
bits within a memory cell as being arranged in a row. The left end of this row is 
called the high-order end, and the right end is called the low-order end. The last 
bit at the high-order end is called either the high-order bit or the most significant 
bit in reference to the fact that if the contents of the cell were interpreted as rep- 
resenting a numeric value, this bit would be the most significant digit in the num- 
ber. Similarly, the bit at the right end is referred to as the low-order bit or the least 
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Figure 1.7 The organization of a byte-size memory cell 
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significant bit. Thus we may represent the contents of a byte-size memory cell as 
shown in Figure 1.7. 

To identify individual cells in a computer's main memory, each cell is assigned 
a unique "name," called its address. The system is analogous to the technique of iden- 
tifying houses in a city by addresses. In the case of memory cells, however, the 
addresses used are entirely numeric. To be more precise, we envision all the cells 
being placed in a single row and numbered in this order starting with the value zero. 
Such an addressing system not only gives us a way of uniquely identifying each cell 
but also associates an order to the cells (Figure 1.8), giving us phrases such as "the next 
cell" or "the previous cell." 

An important consequence of assigning an order to both the cells in main mem- 
ory and the bits within each cell is that the entire collection of bits within a com- 
puter's main memory is essentially ordered in one long row. Pieces of this long row 
can therefore be used to store bit patterns that may be longer than the length of a 
single cell. In particular, we can still store a string of 16 bits merely by using two con- 
secutive memory cells. 

To complete the main memory of a computer, the circuitry that actually holds the 
bits is combined with the circuitry required to allow other circuits to store and retrieve 
data from the memory cells. In this way, other circuits can get data from the mem- 
ory by electronically asking for the contents of a certain address (called a read oper- 
ation), or they can record information in the memory by requesting that a certain bit 
pattern be placed in the cell at a particular address (called a write operation). 

Because a computer's main memory is organized as individual, addressable cells, 
the cells can be accessed independently as required. (This accessibility of individual 
cells in main memory is in stark contrast to the mass storage systems that we will dis- 
cuss in the next section, in which long strings of bits are manipulated as amalgamated 
blocks.) To reflect the ability to access cells in any order, a computer's main memory 
is often called random access memory (RAM). 

Although we have introduced flip-flops as a means of storing bits, the RAM in 
most modern computers is constructed using other technologies that provide 
greater miniaturization and faster response time. Many of these technologies store 
bits as tiny electric charges that dissipate quickly. Thus these devices require addi- 
tional circuitry, known as a refresh circuit, that repeatedly replenishes the charges 
many times a second. In recognition of this volatility, computer memory con- 
structed from such technology is often called dynamic memory, leading to the 
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Figure 1.8 Memory cells arranged by address 
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term DRAM (pronounced "DEE-ram") meaning Dynamic RAM. Or, at times the 
term SDRAM (pronounced "ES-DEE-ram") meaning Synchronous DRAM is used 
in reference to DRAM that applies additional techniques to decrease the time 
needed to retrieve the contents from its memory cells. 

Measuring Memory Capacity 

As we will learn in the next chapter, it is convenient to design main memory systems 
in which the total number of cells is a power of two. In turn, the size of the memo- 
ries in early computers were often measured in 1024 (which is 2 10 ) cell units. Since 
1024 is close to the value 1000, many in the computing community adopted the pre- 
fix kilo in reference to this unit. That is, the term kilobyte (abbreviated KB) was used 
to refer to 1024 bytes. Thus, a machine with 4096 memory cells was said to have a 4KB 
memory (4096 = 4 X 1024). As memories became larger, this terminology grew to 
include the prefixes mega for 1,048,576 (which is 2 20 ) and giga for 1,073,741,824 (which 
is 2 30 ), and units such as MB (megabyte) and GB (gigabyte) became popular. 

Unfortunately, this application of prefixes represents a misuse of terminology 
because these prefixes are already used in other fields in reference to units that are 
powers often. For example, when measuring distance, kilometer refers to 1000 meters, 
and when measuring radio frequencies, megahertz refers to 1,000,000 hertz. Tb make 
matters even worse, some manufacturers of computer equipment have mixed the 
two sets of terminology by using KB to refer to 1024 bytes but using MB to mean an 
even 1000KB (which is 1,024,000 bytes). Needless to say, these discrepancies have 
led to confusion and misunderstandings over the years. 

To clarify matters, a proposal has been made to reserve the prefixes kilo, mega, and 
giga for units that are powers often, and to introduce the new prefixes kibi (short for 
kilobinary and abbreviated Ki), mebi (short for megabinary and abbreviated Mi), and 
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Questions 
& ExerCJSeS 


gibi (short for gigabfnary and abbreviated Gi) in reference to the corresponding units 
that are powers of two. Under this system, the term kibibyte (KiB) would refer to 1024 
bytes, whereas kilobyte (KB) would refer to 1000 bytes. Whether these prefixes become 
a part of the popular vernacular remains to be seen. For now, the traditional "mis- 
use" of the prefixes kilo, mega, and giga remains ingrained in the computing commu- 
nity when referring to main memory, and thus we will follow this tradition in our 
study when referring to data storage. However, the proposed prefixes kibi, megi, and 
gibi do represent an attempt to solve a growing problem, and one would be wise to 
interpret terms such as kilobyte and megabyte with caution in the future. 


1. if the memory cell whose address is 5 contains the value 8, what is the dif- 
ference between writing the value 5 into cell number 6 and moving the con- 
tents of cell number 5 into cell number 6? 

2 Suppose you want to interchange the values stored in memory cells 2 and 3. 
What is wrong with the following sequence of steps: 

Step 1. Move the contents of cell number 2 to cell number 3. 

Step 2. Move the contents of cell number 3 to cell number 2. 

Design a sequence of steps that correctly interchanges the contents of these 
cells. 

3, How many bits would be in the memory of a computer with 4KB (more pre- 
cisely KiB) memory? 


1.3 Mass Storage 

Due to the volatility and limited size of a computer's main memory, most computers 
have additional memory devices called mass storage (or secondary storage) systems, 
including magnetic disks, CDs, DVDs, magnetic tapes, and flash drives (all of which 
we will discuss shortly). The advantages of mass storage systems over main memory 
include less volatility, large storage capacities, low cost, and in many cases, the abil- 
ity to remove the storage medium from the machine for archival purposes. 

The terms on-line and off-line are often used to describe devices that can be either 
attached to or detached from a machine. On-line means that the device or informa- 
tion is connected and readily available to the machine without human intervention. 
Off-line means that human intervention is required before the device or informa- 
tion can be accessed by the machine-perhaps because the device must be turned 
on, or the medium holding the information must be inserted into some mechanism. 

A major disadvantage of mass storage systems is that they typically require 
mechanical motion and therefore require significantly more time to store and retrieve 
data than a machine's main memory, where all activities are performed electronically. 
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Magnetic Systems 

For years, magnetic technology has dominated the mass storage arena. The most com- 
mon example in use today is the magnetic disk, in which a thin spinning disk with 
magnetic coating is used to ho]d data. Read/write heads are placed above and/or 
below the disk so that as the disk spins, each head traverses a circle, called a track, 
around the disk's upper or lower surface. By repositioning the read/write heads, dif- 
ferent concentric tracks can be accessed. In many cases, a disk storage system con- 
sists of several disks mounted on a common spindle, one on top of the other, with 
enough space for the read/write heads to slip between the platters. In such cases, the 
read/write heads move in unison. Each time the read/write heads are repositioned, 
a new set of tracks-which is called a cylinder-becomes accessible. 

Since a track can contain more information than we would normally want to 
manipulate at any one time, each track is divided into small arcs called sectors on 
which information is recorded as a continuous string of bits (Figure 1.9). All sectors 
on a disk contain the same number of bits (typical capacities are in the range of 512 
bytes to a few KB), and in the simplest disk storage systems each track contains the 
same number of sectors. Thus, the bits within a sector on a track near the outer edge 
of the disk are less compactly stored than those on the tracks near the center, since 
the outer tracks are longer than the inner ones. In fact, in high capacity disk storage 
systems, the tracks near the outer edge are capable of containing significantly more 
sectors than those near the center, and this capability is often utilized by applying a 
technique called zoned-bit recording. Using zoned-bit recording, several adjacent 
tracks are collectively known as zones, with a typical disk containing approximately 
ten zones. All tracks within a zone have the same number of sectors, but each zone 
has more sectors per track than the zone inside of it. In this manner, the storage 
space near the outer edge of the disk is used more efficiently than in a traditional disk 


Figure 1.9 A disk storage systerrl 
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system. Regardless of the details, a disk storage system consists of many individual 
sectors, each of which can be accessed as an independent string of bits. 

The location of tracks and sectors is not a permanent part of a disk's physical 
structure. Instead, they are marked magnetically through a process called formatting 
(or initializing) the disk. This process is usually performed by the disk's manufac- 
turer, resulting in what are known as formatted disks. Most computer systems can also 
perform this task. Thus, if the format information on a disk is damaged, the disk can 
be reformatted, although this process destroys all the information that was previously 
recorded on the disk. 

The capacity of a disk storage system depends on the number of disks used and 
the density in which the tracks and sectors are placed. Lower-capacity systems con- 
sist of a single plastic disk known as a diskette or, in those cases in which the disk is 
flexible, by the less prestigious title of floppy disk. Diskettes are easily inserted and 
removed from their corresponding read/write units and are easily stored. As a con- 
sequence, diskettes have been popular for off-line storage of information. However, 
since the generic 372-inch diskettes have a capacity of only 1.44MB, their use is rap- 
idly being replaced by other technologies. 

High-capacity disk systems, capable of holding many gigabytes, consist of per- 
haps five to ten rigid disks mounted on a common spindle. The fact that the disks 
used in these systems are rigid leads them to be known as hard-disk systems, in con- 
trast to their floppy counterparts. To allow for faster rotation speeds, the read/write 
heads in these systems do not touch the disk but instead "float" just off the surface. 
The spacing is so close that even a single particle of dust could become j ammed 
between the head and disk surface, destroying both (a phenomenon known as a head 
crash). Thus hard-disk systems are housed in cases that are sealed at the factory. 

Several measurements are used to evaluate a disk system's performance: (1) seek 
time (the time required to move the read/write heads from one track to another); 
(2) rotation delay or latency time (half the time required for the disk to make a com- 
plete rotation, which is the average amount of time required for the desired data to 
rotate around to the read/write head once the head has been positioned over the 
desired track); (3) access time (the sum of seek time and rotation delay); and 
(4) transfer rate (the rate at which data can be transferred to or from the disk). (Note 
that in the case of zone-bit recording, the amount of data passing a read/write head in 
a single disk rotation is greater for tracks in an outer zone than for an inner zone, and 
therefore the data transfer rate varies depending on the portion of the disk being used.) 

Hard-disk systems generally have significantly better characteristics than floppy 
systems. Since the read/write heads do not touch the disk surface in a hard-disk sys- 
tem, one finds rotation speeds of several thousand revolutions per minute, whereas 
disks in floppy-disk systems rotate on the order of 300 revolutions-per-minute. Con- 
sequently, transfer rates for hard-disk systems, usually measured in MB per second, 
are much greater than those associated with floppy-disk systems, which tend to be 
measured in KB per second. 

Since disk systems require physical motion for their operation, both hard and 
floppy systems suffer when compared to speeds within electronic circuitry. Delay 
times within an electronic circuit are measured in units of nanoseconds (billionths of 
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a second) or less, whereas seek times, latency times, and access times of disk sys- 
tems are measured in milliseconds (thousandths of a second). Thus the time required 
to retrieve information from a disk system can seem like an eternity to an electronic 
circuit awaiting a result. 

Disk storage systems are not the only mass storage devices that apply magnetic 
technology. An older form of mass storage using magnetic technology is magnetic 
tape (Figure 1.10). In these systems, information is recorded on the magnetic coating 
of a thin plastic tape that is wound on a reel for storage. To access the data, the tape is 
mounted in a device called a tape drive that typically can read, write, and rewind the 
tape under control of the computer. Tape drives range in size from small cartridge 
units, called streaming tape units, which use tape similar in appearance to that in 
stereo systems to older, large reel-to-reel units. Although the capacity of these devices 
depends on the format used, most can hold many GB. 

A major disadvantage of magnetic tape is that moving between different posi- 
tions on a tape can be very time-consuming owing to the significant amount of tape 
that must be moved between the reels. Thus tape systems have much longer data 
access times than magnetic disk systems in which different sectors can be accessed 
by short movements of the read/write head. In turn, tape systems are not popular for 
on-line data storage. Instead, magnetic tape technology is reserved for off-line archival 
data storage applications where its high capacity, reliability, and cost efficiency are 
beneficial, although advances in alternatives, such as DVDs and flash drives, are rap- 
idly challenging this last vestige of magnetic tape. 

Optical Systems 

Another class of mass storage systems applies optical technology. An example is the 
compact disk (CD). These disks are 12 centimeters (approximately 5 inches) in 
diameter and consist of reflective material covered with a clear protective coating. 


Figure 1.10 A magnetic tape storage mechanism 
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Information is recorded on them by creating variations in their reflective surfaces. This 
information can then be retrieved by means of a laser beam that monitors irregular- 
ities on the reflective surface of the CD as it spins. 

CD technology was originally applied to audio recordings using a recording for- 
mat known as CD-DA (compact disk-digital audio), and the CDs used today for 
computer data storage use essentially the same format. In particular, information on 
these CDs is stored on a single track that spirals around the CD like a groove in an old- 
fashioned record, however, unlike old-fashioned records, the track on a CD spirals 
from the inside out (Figure 1.11). This track is divided into units called sectors, each 
with its own identifying markings and a capacity of 2KB of data, which equates to 'M 
of a second of music in the case of audio recordings. 

Note that the distance around the spiraled track is greater toward the outer edge 
of the disk than at the inner portion. To maximize the capacity of a CD, information 
is stored at a uniform linear density over the entire spiraled track, which means that 
more information is stored in a loop around the outer portion of the spiral than in a 
loop around the inner portion. In turn, more sectors will be read in a single revolu- 
tion of the disk when the laser beam is scanning the outer portion of the spiraled 
track than when the beam is scanning the inner portion of the track. Thus, to obtain 
a uniform rate of data transfer, CD-DA players are designed to vary the rotation speed 
depending on the location of the laser beam. However, most CD systems used for 
computer data storage spin at a faster, constant speed and thus must accommodate 
variations in data transfer rates. 

As a consequence of such design decisions, CD storage systems perform best 
when dealing with long, continuous strings of data, as when reproducing music. In 
contrast, when an application requires access to items of data in a random manner, 
the approach used in magnetic disk storage (individual, concentric tracks divided into 
individually accessible sectors) outperforms the spiral approach used in CDs. 

Figure 1.11 CD storage format 
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Traditional CDs have capacities in the range of 600 to 700MB. However, newer 
DVDs (Digital Versatile Disks), which are constructed from multiple, semi-trans- 
parent layers that serve as distinct surfaces when viewed by a precisely focused laser, 
provide storage capacities of several GB. Such disks are capable of storing lengthy 
multimedia presentations, including entire motion pictures. 


Flash Drives 

A common property of mass storage systems based on magnetic or optic technology 
is that physical motion, such as spinning disks, moving read/write heads, and aiming 
laser beams, is required to store and retrieve data. This means that data storage and 
retrieval is slow compared to the speed of electronic circuitry. Flash memory tech- 
nology has the potential of alleviating this drawback. In a flash memory system, bits 
are stored by sending electronic signals directly to the storage medium where they 
cause electrons to be trapped in tiny chambers of silicon dioxide, thus altering the 
characteristics of small electronic circuits. Since these chambers are able to hold their 
captive electrons for many years, this technology is suitable for off-line storage of data. 

Although data stored in flash memory systems can be accessed in small byte-size 
units as in RAM applications, current technology dictates that stored data be erased 
in large blocks. Moreover, repeated erasing slowly damages the silicon dioxide cham- 
bers, meaning that current flash memory technology is not suitable for general main 
memory applications where its contents might be altered many times a second. How- 
ever, in those applications in which alterations can be controlled to a reasonable level, 
such as in digital cameras, cellular telephones, and hand-held PDAs, flash memory has 
become the mass storage technology of choice. Indeed, since flash memory is not 
sensitive to physical shock (in contrast to magnetic and optic systems) its potential 
in portable applications is enticing. 

Flash memory devices called flash drives, with capacities of up to a few GB, are 
available for general mass storage applications. These units are packaged in small 
plastic cases approximately three inches long with a removable cap on one end to 
protect the unit's electrical connector when the drive is off-line. The high capacity of 
these portable units as well as the fact that they are easily connected to and discon- 
nected from a computer make them ideal for off-line data storage. However, the vul- 
nerability of their tiny storage chambers dictates that they are not as reliable as optical 
disks for truly long term applications. 

File Storage and Retrieval 

Information stored in a mass storage system is conceptually grouped into large units 
called files. A typical file may consist of a complete text document, a photograph, a 
program, a music recording, or a collection of data about the employees in a com- 
pany. We have seen that mass storage devices dictate that these files be stored and 
retrieved in smaller, multiple byte units. For example, a file stored on a magnetic disk 
must be manipulated by sectors, each of which is a fixed predetermined size. A block 
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•f data conforming to the specific characteristics of a storage device is called a phys- 
ical record. Thus, a large File stored in mass storage will typically consist of many 
physical records. 

In contrast to this division into physical records, a file often has natural divisions 
determined by the information represented. For example, a file containing informa- 
tion regarding a company’s employees would consist of multiple units, each consist- 
ing of the information about one employee. Or, a file containing a text document 
would consist of paragraphs or pages. These naturally occurring blocks of data are 
called logical records. 

Logical records often consist of smaller units called Fields. For example, a logical 
record containing information about an employee would probably consist of fields 
such as name, address, employee identification number, etc. Sometimes each logical 
record within a file is uniquely identified by means of a particular field within the 
record (perhaps an employee's identification number, a part number, or a catalogue 
item number). Such an identifying field is called a key field. The value held in a key 
field is called a key. 

Logical record sizes rarely match the physical record size dictated by a mass stor- 
age device. In turn, one may find several logical records residing within a single phys- 
ical record or perhaps a logical record split between two or more physical records 
(Figure 1.12). The result is that a certain amount of unscrambling is associated with 
retrieving data from mass storage systems. A common solution to this problem is to 
set aside an area of main memory that is large enough to hold several physical records 
and to use this memory space as a regrouping area. That is, blocks of data compati- 
ble with physical records can be transferred between this main memory area and the 
mass storage system, while the data residing in the main memory area can be refer- 
enced in terms of logical records. 

Figure 1.12 Logical records versus physical records on a disk 
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An area of memory used in this manner is called a buffer. In general, a buffer 
is a storage area used to hold data on a temporary basis, usually during the process of 
being transferred from one device to another. For example, modern printers contain 
memory circuitry of their own, a large part of which is used as a buffer for holding 
portions of a document that have been received by the printer but not yet printed. 


1. What advantage does a hard-disk system gain from tibe: tfakctt ttllnaitf iitts^ 
faster than disks in a floppy-disk system? 

2. When recording data on a multiple-disk storage system, should we fill a com- 
plete disk surface before starting on another surface, or should we first fill an 
entire cylinder before starting on another cylinder? 

3. Why should the data in a reservation system that is constantly being updated 
be stored on a magnetic disk instead of a CD or DVD? 

4. Sometimes, when modifying a document with a wOM proce&&0T, adding text 
does not increase the apparent size of the file in mass storage, but at other 
times the addition of a single symbol can increase the apparent size of the file 
by several hundred bytes. Why? 

5. What advantage do flash drives have over the other mass storage systems 
introduced in this section? 

6. What is a buffer? 

1.4 Representing Information as Bit Patterns 

Having considered techniques for storing bits, we now consider how information can 
be encoded as bit patterns. Our study focuses on popular methods for encoding text, 
numerical data, images, and sound. Each of these systems has repercussions that are 
often visible to a typical computer user. Our goal is to understand enough about these 
techniques so that we can recognize their consequences for what they are. 

Representing Text 

Information in the form of text is normally represented by means of a code in which 
each of the different symbols in the text (such as the letters of the alphabet and punc- 
tuation marks) is assigned a unique bit pattern. The text is then represented as a long 
string of bits in which the successive patterns represent the successive symbols in 
the original text. 

In the 1940s and 1950s, many such codes were designed and used in connection 
with different pieces of equipment, producing a corresponding proliferation of com- 
munication problems. To alleviate this situation, the American National Standards 
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Institute (ANSI, pronounced "AN-see") adopted the American Standard Code for 
Information Interchange (ASCII, pronounced "AS-kee"). This code uses bit pat- 
terns of length seven to represent the upper- and lowercase letters of the English 
alphabet, punctuation symbols, the digits 0 through 9, and certain control information 
such as line feeds, carriage returns, and tabs. Today, ASCII is often extended to an 
eight-bit-per-symbol format by adding a 0 at the most significant end of each of the 
seven-bit patterns. This technique not only produces a code in which each pattern fits 
conveniently into a typical byte-size memory cell but also provides 128 additional bit 
patterns (those obtained by assigning the extra bit the value 1) that can represent 
symbols excluded in the original ASCII. Unfortunately, because vendors tend to use 
their own interpretations for these extra patterns, data in which these patterns appear 
often are not easily transported from one vendor's application to another. 

A portion of ASCII in its eight-bit-per-symbol format is shown in Appendix A. By 
referring to this appendix, we can decode the bit pattern 

01001000 01100101 01101100 01101100 01101111 00101110 

as the message "Hello" as demonstrated in Figure 1.13. 

Although ACSII has been the dominant code for many years, other more extensive 
codes, capable of representing documents in a variety of languages, are now compet- 
ing for popularity. One of these, Unicode, was developed through the cooperation of 
several of the leading manufacturers of hardware and software and is rapidly gaining 
support in the computing community. This code uses a unique pattern of 16 bits to rep- 
resent each symbol. As a result, Unicode consists of 65,536 different bit patterns- 
enough to allow text written in such languages as Chinese, Japanese, and Hebrew to 
be represented. 

Standards for a code that could compete with Unicode have been developed by 
the International Organization for Standardization (also known as ISO, in refer- 
ence to the Greek word isos, meaning equal). Using patterns of 32 bits, this encoding 
system has the potential of representing billions of different symbols. 

A file consisting of a long sequence of symbols encoded using ASCII or Unicode 
is often called a text file. It is important to distinguish between simple text files that 
are manipulated by utility programs called text editors (or often simply editors) and 
the more elaborate files produced by word processors. Both consist of textual mate- 
rial. However, a text file contains only a character-by-character encoding of the text, 
whereas a file produced by a word processor contains numerous proprietary codes rep- 
resenting changes in fonts, alignment information, etc. Moreover, word processors 


Figure 1.13 The messoge "Hello." in ASCII 
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The American National Standards Institute 

The American National Standards Institute (ANSI) was founded in 1918 by a 
small consortium of engineering societies and government agencies as a non- 
profit federation to coordinate the development of voluntary standards in the 
private sector. Today, ANSI membership includes more than 1300 businesses, 
professional organizations, trade associations, and government agencies. ANSI 
is headquartered in New York and represents the United States as a member 
body in the ISO. The website for the American National Standards Institute is 
at http://www.ansi.org. 

Similar organizations in other countries include Standards Australia (Aus- 
tralia), Standards Council of Canada (Canada), China State Bureau of Quality and 
Technical Supervision (China), Deutsches Institur fur Normung (Germany), 
Japanese Industrial Standards Committee (Japan), Direccidn General de Normas 
(Mexico), State Committee of the Russian Federation for Standardization and 
Metrology (Russia), Swiss Association for Standardization (Switzerland), and 
British Standards Institution (United Kingdom). 


may even use proprietary codes rather than a standard such as ASCII or Unicode for 
representing the text itself. 

Representing Numeric Values 

Storing information in terms of encoded characters is inefficient when the informa- 
tion being recorded is purely numeric, lb see why, consider the problem of storing 
the value 25. If we insist on storing it as encoded symbols in ASCII using one byte per 
symbol, we need a total of 16 bits. Moreover, the largest number we could store using 
16 bits is 99. However, as we will shortly see, by using binary notation we can store 
any integer in the range from 0 to 65535 in these 16 bits. Thus, binary notation (or vari- 
ations of it) is used extensively for encoded numeric data for computer storage. 

Binary notation is a way of representing numeric values using only the digits 0 
and 1 rather than the digits 0, 1, 2, 3, 4, 5, 6, 7, 8, and 9 as in the traditional decimal, 
or base ten, system. We will study the binary system more thoroughly in Section 1.5. 
For now, all we need is an elementary understanding of the system. For this purpose 
consider an old-fashioned car odometer whose display wheels contain only the dig- 
its 0 and 1 rather than the traditional digits 0 through 9. The odometer starts with a 
reading of all Os, and as the car is driven for the first few miles, the rightmost wheel 
rotates from a 0 to a 1. Then, as that 1 rotates back to a 0, it causes a 1 to appear to 
its left, producing the pattern 10. The 0 on the right then rotates to a 1, producing 
11. Now the rightmost wheel rotates from 1 back to 0, causing the 1 to its left 
to rotate to a 0 as well. This in turn causes another 1 to appear in the third column. 
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producing the pattern 100. In short, as we drive the car we see the following sequence 
of odometer readings: 

0000 

0001 

0010 

0011 

0100 

0101 

0110 

0111 

1000 

This sequence consists of the binary representations of the integers zero through 
eight. Although tedious, we could extend this counting technique to discover that the 
bit pattern consisting of sixteen Is represents the value 65535, which confirms our 
claim that any integer in the range from 0 to 65535 can be encoded using 16 bits. 

Due to this efficiency, it is common to store numeric information in a form of 
binary notation rather than in encoded symbols. We say "a form of binary notation" 
because the straightforward binary systemjust described is only the basis for several 
numeric storage techniques used within machines. Some of these variations of the 
binary system are discussed later in this chapter. For now, we merely note that a sys- 
tem called two’s complement notation (see Section 1.6) is common for storing whole 
numbers because it provides a convenient method for representing negative num- 
bers as well as positive. For representing numbers with fractional parts such as 4Vi or 
'A, another technique, called floating-point notation (see Section 1.7), is used. 

Representing Images 

Today's computer applications involve more than just text and numeric data. They 
include images, audio, and video. Popular techniques for representing images can be 
classified into two categories: bit map techniques and vector techniques. In the 
case of bit map techniques, an image is represented as a collection of dots, each of 
which is called a pixel, short for "picture element." A black and white image is then 
encoded as a long string of bits representing the rows of pixels in the image, where 
each bit is either 1 or 0 depending on whether the corresponding pixel is black or 
white. This is the approach used by most facsimile machines. 

The term bit map originated from the fact that the bits representing an image in 
a one-bit-per-pixel format are little more than a map of the image. Today the term 
has been generalized to include all systems in which images are encoded in a pixel- 
by-pixel manner. For example, in the case of black and white photographs, each pixel 
is represented by a collection of bits (usually eight), which allows a variety of shades 
of grayness to be represented. 

This bit map approach is generalized further for color images, where each pixel 
is represented by a combination ofbits indicating the appearance ofthat pixel. Two 
approaches are common. In one, which we will call RGB encoding, each pixel is 
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ISO — The International Organization for 
Standardization 

The International Organization for Standardization (more commonly called ISO) 
was established in 1947 as a worldwide federation of standardization bodies, one 
from each country. Today, it is headquartered in Geneva, Switzerland and has 
more than 100 member bodies as well as numerous correspondent members. 

(A correspondent member is usually a standardization body from a country that 
does not have a nationally recognized standardization body. Such members can- 
not participate directly in the development of standards but are kept informed of 
ISO activities.) ISO maintains a website at http: //www.iso.ch . 


represented as three color components — a red component, a green component, and 
a blue component-corresponding to the three primary colors of light. One byte is 
normally used to represent the intensity of each color component. In turn, three 
bytes of storage are required to represent a single pixel in the original image. 

A popular alternative to simple RGB encoding is to use a "brightness" component 
and two color components. In this case the "brightness" component, which is called 
the pixel's luminance, is essentially the sumofthe red, green, and blue components. 
(Actually, it is the amount of white light in the pixel, but these details need not con- 
cern us here.) The other two components, called the blue chrominance and the red 
chrominance, are determined by computing the difference between the pixel's lumi- 
nance and the amount ofblue or red light, respectively, in the pixel. Together these 
three components contain the information required to reproduce the pixel. 

The popularity of encoding images using luminance and chrominance compo- 
nents originated in the field of color television broadcast because this approach pro- 
vided a means of encoding color images that was also compatible with older 
black-and-white television receivers. Indeed, a gray-scale version of an image can be 
produced by using only the luminance components of the encoded color image. 

One disadvantage of bit map techniques is that an image cannot be rescaled eas- 
ily to any arbitrary size. Essentially, the only way to enlarge the image is to make the 
pixels bigger, which leads to a grainy appearance. (This is the technique called "digi- 
tal zoom" used in digital cameras as opposed to "optical zoom" that is obtained by 
adjusting the camera lens.) Vector techniques provide a means of overcoming this 
scaling problem. Using this approach, an image is represented as a collection of lines 
and curves. Such a description leaves the details of how the lines and curves are drawn 
to the device that ultimately produces the image rather than insisting that the device 
reproduce a particular pixel pattern. 

The various fonts available via today's word processing systems are usually encoded 
using vector techniques in order to provide flexibility in character size, resulting in 
scalable fonts. For example, TrueType (developed by Microsoft and Apple Computer) 
is a system for describing how symbols in text are to be drawn. Likewise, PostScript 
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(developed by Adobe Systems) provides a means of describing characters as well as 
more general pictorial data. Vector representation techniques are also popular in 
computer-aided design (CAD) systems in which drawings of three-dimensional 
objects are displayed and manipulated on computer screens. 


Representing Sound 


The most generic method of encoding audio information for computer storage and 
manipulation is to sample the amplitude of the sound wave at regular intervals and 
record the series of values obtained. For instance, the series 0, 1.5, 2.0, 1.5, 2.0, 3.0, 
4.0, 3.0, 0 would represent a sound wave that rises in amplitude, falls briefly, rises to 
a higher level, and then drops back to 0 (Figure 1.14). This technique, using a sam- 
ple rate of 8000 samples per second, has been used for years in long-distance voice 
telephone communication. The voice at one end of the communication is encoded as 
numeric values representing the amplitude of the voice every eight-thousandth of a 
second. These numeric values are then transmitted over the communication line to 
the receiving end, where they are used to reproduce the sound of the voice. 

Although 8000 samples per second may seem to be a rapid rate, it is not sufficient 
for high-fidelity music recordings. To obtain the quality sound reproduction obtained by 
today's musical CDs, a sample rate of 44,100 samples per second is used. The data 
obtained from each sample are represented in 16 bits (32 bits for stereo recordings). 
Consequently, each second of music recorded in stereo requires more than a million bits. 

An alternative encoding system known as Musical Instrument Digital Interface 
(MIDI, pronounced "MID-ee") is widely used in the music synthesizers found in elec- 
tronic keyboards, for video game sound, and for sound effects accompanying websites. 
By encoding directions for producing music on a synthesizer rather than encoding the 

Figure 1.14 The sound wave represented by the sequence 0, 1.5, 2.0, 1.5, 2.0, 3.0, 4.0, 3.0, 0 
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sound itself, MIDI avoids the large storage requirements of the sampling technique. 
More precisely, MIDI encodes what instrument is to play which note for what dura- 
tion of time, which means that a clarinet playing the note D for two seconds can be 
encoding in three bytes rather than more than two million bits when sampled at a rate 
of 44,100 samples per second. 

In short, MIDI can be thought of as a way of encoding the sheet music read by a 
performer rather than the performance itself, and in turn, a MIDI "recording" can 
sound significantly different when performed on different synthesizers. 


Questions 
& Exercises 


2. In the ASCII code, what is the relationship between the codes for an Upper- 
Case letter and the same letter in lowercase? (See Appendix A) 

3. Encode these sentences in ASCII: 

a. Where are you? 

b. "How?" Cheryl asked. 

c. 2 + 3 = 5. 

4 Describe a device from everyday life that can be in either of two states, such 
as a flag on a flagpole that is either up or down. Assign the symbol 1 to one of 
the states and 0 to the other, and show how the ASCII representation for the 
letter b would appear when stored with such bits. 

5. Convert each of the following binary representations to its equivalent base 
ten form: 

a. 0101 b. 1001 c. 1011 

d. 0110 e. 10000 f. 10010 

6. Convert each of the following base ten representations to its equivalent 
binary form: 

a. 6 b. 13 c. 11 

d. 18 e. 27 f. 4 

7. What is the largest numeric value that could be represented with three bytes 
if each digit were encoded using one ASCII pattern per byte? What if binary 
notation were used? 

8. An alternative to hexadecimal notation for representing bit patterns is dotted 
decimal notation in which each byte in the pattern is represented by its 
base ten equivalent. In turn, these byte representations are separated by 
periods. For example, 12.5 represents the pattern 0000110000000101 (the byte 


1 . Here is a message encoded in ASCII using eight bits per symbol. What does it 
say? (See Appendix A) 

01000011 01101111 01101101 01110000 01110101 01110100 

01100101 01110010 00100000 01010011 01100011 01101001 

01100101 01101110 01100011 01100101 
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00001100 is represented by 12, and 00000101 is represented by 5), and the 
pattern 100010000001000000000111 is represented by 136.16.7. Represent 
each of the following bit patterns in dotted decimal notation, 
a. 0000111100001111 b. 001100110000000010000000 

c. 0000101010100000 

9. What is an advantage of representing images via vector techniques as 

opposed to bit map techniques? What about bit map techniques as opposed 
to vector techniques? 

1 0. Suppose a stereo recording of one hour of music is encoded using a sample 
rate of 44, 100 samples per second as discussed in the text. How does the size 
of the encoded version compare to the storage capacity of a CD? 


1.5 The Binary System 

In Section 1,4 we saw that binary notation is a means of representing numeric values 
using only the digits 0 and 1 rather than the ten digits 0 through 9 that are used in the 
more common base ten notational system. It is time now to look at binary notation 
more thoroughly. 

Binary Notation 

Recall that in the base ten system, each position in a representation is associated 
with a quantity. In the representation 375, the 5 is in the position associated with the 
quantity one, the 7 is in the position associated with ten, and the 3 is in the position 
associated with the quantity one hundred (Figure 1,15a). Each quantity is ten times 
that of the quantity to its right. The value represented by the entire expression is 
obtained by multiplying the value of each digit by the quantity associated with that 
digit's position and then adding those products. To illustrate, the pattern 375 repre- 
sents (3 X hundred) + (7 X ten) + (5 X one). 


Figure 1.15 The base ten and binary systems 
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Figure 1.16 Decoding the binary representation 100101 
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The position of each digit in binary notation is also associated with a quantity, 
except that the quantity associated with each position is twice the quantity associ- 
ated with the position to its right. More precisely, the rightmost digit in a binary rep- 
resentation is associated with the quantity one (2°), the next position to the left is 
associated with two (2 ), the next is associated with four (2 2 ), the next with eight (Z 3 ), 
and so on. For example, in the binary representation 1011, the rightmost 1 is in the posi- 
tion associated with the quantity one, the 1 next to it is in the position associated with 
two, the 0 is in the position associated with four, and the leftmost 1 is in the position 
associated with eight (Figure 1.15b). 

To extract the value represented by a binary representation, we follow the same 
procedure as in base ten- we multiply the value of each digit by the quantity associ- 
ated with its position and add the results. For example, the value represented by 100101 
is 37, as shown in Figure 1.16. Note that since binary notation uses only the digits 0 
and 1, this multiply-and-add process reduces merely to adding the quantities associ- 
ated with the positions occupied by Is. Thus the binary pattern 1011 represents the 
value eleven, because the Is are found in the positions associated with the quantities 
one, two, and eight. 

In Section 1.4 we learned how to count in binary notation, which allowed us to 
encode small integers. For finding binary representations of large values, you may pre- 
fer the approach described by the algorithm in Figure 1.17. Let us apply this algorithm 


Figure 1.17 An algorithm for finding the binary representation of a positive integer 


Step 1. Divide the value by two and record the remainder. 

Step 2. As long as the quotient obtained is not zero, continue to divide 

the newest quotient by two and record the remainder. 

Step 3. Now that a quotient of zero has been obtained, the binary 

representation of the original value consists of the remainders 
listed from right to left in the order they were recorded. 
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Figure 1.18 Applying the algorithm in Figure 1.17 to obtain the binary representation of thirteen 



Binary representation 


to the value thirteen (Figure 1.18). We First divide thirteen by two, obtaining a quo- 
tient of six and a remainder of one. Since the quotient was not zero, Step 2 tells us to 
divide the quotient (six) by two, obtaining a new quotient of three and a remainder of 
zero. The newest quotient is still not zero, so we divide it by two, obtaining a quotient 
of one and a remainder of one. Once again, we divide the newest quotient (one) by two, 
this time obtaining a quotient of zero and a remainder of one. Since we have now 
acquired a quotient of zero, we move on to Step 3, where we learn that the binary rep- 
resentation of the original value (thirteen) is 1101, obtained from the list of remainders. 

Binary Addition 

To add two integers represented in binary notation, we begin, just as we did with base 
ten in elementary school, by memorizing the addition facts (Figure 1.19). Using these 
facts, we add two values as follows: First, add the digits in the right-hand column, 
write the least significant digit of this sum under the column, carry the more signif- 
icant digit of the sum (if there is one) to the next column to the left, and proceed by 
adding that column. For example, to solve the problem 

111010 
+ 11011 

we begin by adding the rightmost 0 and 1; we obtain 1, which we write below the col- 
umn. Now we add the 1 and 1 from the next column, obtaining 10. We write the 0 from 


1,5 The Binary System 6 3 


Figure 1.19 The binary addition facts 


0 1 o i 

+ 0 +0 . +i +i 

0 1 1 10 

this 10 under the column and carry the 1 to the top of the next column. At this point, 
our solution looks like this: 

1 

1110 10 
, + 11011 

01 

We add the 1, 0, and 0 in the next column, obtain 1, and write the 1 under this col- 
umn. The 1 and 1 from the next column total 10; we write the 0 under the column and 
carry the 1 to the next column. Now our solution looks like this: 

1 

111010 
+ 11011 

0101 

The 1, 1, and 1 in the next column total 11 (binary notation for the value three); we 
write the low-order 1 under the column and carry the other 1 to the top of the next 
column. We add that 1 to the 1 already in that column to obtain 10. Again, we record 
the low-order 0 and carry the 1 to the next column. We now have 

1 

111010 
+ 11011 

010101 

The only entry in the next column is the 1 that we carried from the previous column 
so we record it in the answer. Our final solution is this: 

111010 
+ 11011 . , 

1010101 

Fractions in Binary 

To extend binary notation to accommodate fractional values, we use a radix point in 
the same role as the decimal point in decimal notation. That is, the digits to the left 
of the point represent the integer part (whole part) of the value and are interpreted 
as in the binary system discussed previously. The digits to its right represent the frac- 
tional part of the value and are interpreted in a manner similar to the other bits, 
except that their positions are assigned fractional quantities. That is, the first posi- 
tion to the right of the radix is assigned the quantity >h, the next position the quantity 
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Figure 1.20 Decoding the binary representation 101.101 
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% the next'/», and so on. Note that this is merely a continuation of the rule stated pre- 
viously: Each position is assigned a quantity twice the size of the one to its right. With 
these quantities assigned to the bit positions, decoding a binary representation con- 
taining a radix point requires the same procedure as used without a radix point. More 
precisely, we multiply each bit value by the quantity assigned to that bit’s position in 
the representation. To illustrate, the binary representation 101.101 decodes to 57e, as 
shown in Figure 1.20. 

For addition, the techniques applied in the base ten system are also applicable in 
binary. That is, to add two binary representations having radix points, we merely 
align the radix points and apply the same addition process as before. For example, 
10.011 added to 100.11 produces 111.001, as shown here: 

10.011 

+ 100.110 

1 11.001 


Questions 
& Exercises 


1. Convert each of the following binary representations to its equivalent base 
ten form: 

a. 101010 b. 100001 c. 10111 d. 0110 

e. 11111 

2. Convert each of the following base ten representations to its equivalent 
binary form: 

a. 32 b. 64 c. 96 d. 15 

e. 27 

3. Convert each of the following binary representations to its equivalent base 
ten form: 


a. 11.01 
e. 0.101 


b. 101.111 


c. 10.1 


d. 110.011 
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4. Express the following values in binary notation: 


a. 4V 2 


b. 2’ A 


c. 17« 


d. 7„ 


e. 5V» 


5, Perform the 
a. 11011 
+ 1100 


following additions in binary notation: 

b. 1010.001 C. 11111 
+ -LI 01 +0001 


d. 111.11 
+ 00.01 
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Mathematicians have long been interested in numeric notational systems, and many 
of their ideas have turned out to be very compatible with the design of digital cir- 
cuitry. In this section we consider two ofthese notational systems, two's complement 
notation and excess notation, which are used for representing integer values in com- 
puting equipment. These systems are based on the binary system but have additional 
properties that make them more compatible with computer design. With these advan- 
tages, however, come disadvantages as well. Our goal is to understand these proper- 
ties and how they affect computer usage. 


Analog Versus Digital 


Prior to the 21st century, many researchers debated the pros and cons of digital 
versus analog technology. In a digital system, a value is encoded as a series of 
digits and then stored using several devices, each representing one of the digits. 
In an analog system, each value is stored in a single device that can represent 
any value within a continuous range. 

Let us compare the two approaches using buckets of water as the storage 
devices. To simulate a digital system, we could agree to let an empty bucket 
represent the digit 0 and a full bucket represent the digit 1. Then we could store 
a numeric value in a row of buckets using floating-point notation (see Section 
1.7). In contrast, we could simulate an analog system by partially filling a single 
bucket to the point at which the water level represented the numeric value 
being represented. At first glance, the analog system may appear to be more 
accurate since it would not suffer from the truncation errors inherent in the 
digital system (again see Section 1.7). However, any movement of the bucket in 
the analog system could cause errors in detecting the water level, whereas a sig- 
nificant amount of sloshing would have to occur in the digital system before the 
distinction between a full bucket and an empty bucket would be blurred. Thus 
the digital system would be less sensitive to error than the analog system. This 
robustness is a major reason why many applications that were originally based 
on analog technology (such as telephone communication, audio recordings, and 
television) are shifting to digital technology. 


Two's Complement Notation 

The most popular system for representing integers within today's computers is two's 
complement notation. This system uses a fixed number ofbits to represent each of 
the values in the system. In today's equipment, it is common to use a two's comple- 
ment system in which each value is represented by a pattern of 32 bits. Such a large 
system allows a wide range of numbers to be represented but is awkward for demon- 
stration purposes. Thus, to study the properties of two's complement systems, we 
will concentrate on smaller systems. 

Figure 1.21 shows two complete two's complement systems-one based on bit pat- 
terns of length three, the other based on bit patterns of length four. Such a system is con- 
structed by starting with a string of Os of the appropriate length and then counting in 
binary until the pattern consisting of a single 0 followed by Is is reached. These patterns 
represent the values 0, 1, 2, 3, ... . The patterns representing negative values are 
obtained by starting with a string of Is of the appropriate length and then counting 
backward in binary until the pattern consisting of a single 1 followed by Os is reached. 

These patterns represent the values - 1 , -2, -3, (If counting backward in binary is 

difficult for you, merely start at the very bottom of the table with the pattern consisting 
of a single 1 followed by Os, and count up to the pattern consisting of all Is.) 

Note that in a two's complement system, the leftmost bit of a bit pattern indi- 
cates the sign of the value represented. Thus, the leftmost bit is often called the 


Figure 1.21 Two's complement notation systems 


a. Using patterns of length three 


Bit 

pattern 

Value 

represented 

Oil 

3 

010 

2 

001 

1 

000 

0 

1 1 1 

- 1 

110 

-2 

101 

-3 

100 

-4 


b. Using patterns of length four 
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sign bit. In a two's complement system, negative values are represented by the 
patterns whose sign bits are 1; nonnegative values are represented by patterns whose 
sign bits are 0. 

In a two's complement system, there is a convenient relationship between the pat- 
terns representing positive and negative values of the same magnitude. They are 
identical when read from right to left, up to and including the first 1. From there on, 
the patterns are complements of one another. (The complement of a pattern is the 
pattern obtained by changing all the Os to Is and all the Is to Os 0110 and 1001 arc com- 
plements.) For example, in the four-bit system in Figure 1.21 the patterns representing 
2 and -2 both end with 10, but the pattern representing 2 begins with 00, whereas the 
pattern representing -2 begins with 11. This observation leads to an algorithm for 
converting back and forth between bit patterns representing positive and negative 
values of the same magnitude. We merely copy the original pattern from right to left 
until a 1 has been copied, then we complement the remaining bits as they are trans- 
ferred to the final bit pattern (Figure 1.22). 

Understanding these basic properties of two's complement systems also leads to 
an algorithm for decoding two's complement representations. If the pattern to be 
decoded has a sign bit of 0, we need merely read the value as though the pattern were 
a binary representation. For example, 0110 represents the value 6, because 110 is binary 
for 6. If the pattern to be decoded has a sign bit of 1, we know the value represented 
is negative, and all that remains is to find the magnitude of the value. We do this by 
applying the "copy and complement" procedure in Figure 1.22 and then decoding the 
pattern obtained as though it were a straightforward binary representation. For exam- 
ple, to decode the pattern 1010, we first recognize that since the sign bit is 1, the value 
represented is negative. Hence, we apply the "copy and complement" procedure to 
obtain the pattern to 0110, recognize that this is the binary representation for 6, and 
conclude that the original pattern represents -6. 


Figure 1.22 Encoding the value -6 in two's complement notation using four bits 
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Addition in Two's Complement Notation Tb add values represented in two's 
complement notation, we apply the same algorithm that we used for binary addi- 
tion, except that all bit patterns, including the answer, are the same length. This 
means that when adding in a two's complement system, any extra bit generated on 
the left of the answer by a final carry must be truncated. Thus "adding" 0101 and 
0010 produces 0111, and "adding" 0111 and 1011 results in 0010 (0111 + 1011 = 10010, 
which is truncated to 0010). 

With this understanding, consider the three addition problems in Figure 1.23. In 
each case, we have translated the problem into two's complement notation (using bit 
patterns of length four), performed the addition process previously described, and 
decoded the result back into our usual base ten notation. 

Observe that the third problem in Figure 1.23 involves the addition of a positive 
number to a negative number, which demonstrates a major benefit of two's comple- 
ment notation: Addition of any combination of signed numbers can be accomplished 
using the same algorithm and thus the same circuitry. This is in stark contrast to how 
humans traditionally perform arithmetic computations. Whereas elementary school- 
children are first taught to add and later taught to subtract, a machine using two's 
complement notation needs to know only how to add. 

For example, the subtraction problem 7 - 5 is the same as the addition problem 
7 + (-5). Consequently, if a machine were asked to subtract 5 (stored as 0101) from 
7 (stored as 0111), it would first change the 5 to -5 (represented as 1011) and then 
perform the addition process of 0111 + 1011 to obtain 0010, which represents 2, as 
follows: 


7 0111 0111 

=5. -> - 0101 -> + 1011 

0010 -> 2 


Figure 1.23 Addition problems converted to two's complement notation 


Problem in Problem in Answer in 

base ten two's complement base ten 

3 0011 

9 ► + 0010 

0101 ► 5 

1101 
+ 1110 

1011 ► -5 

0111 
+ 1011 

0010 ► 2 


-3 

+ -2 


7 

+ -5 
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We see, then, that when two's complement notation is used to represent numeric val- 
ues, a circuit for addition combined with a circuit for negating a value is sufficient for 
solving both addition and subtraction problems. (Such circuits are shown and 
explained in Appendix B.) 

The Problem of Overflow One problem we have avoided in the preceding exam- 
ples is that in any two's complement system there is a limit to the size of the values 
that can be represented. When using two's complement with patterns of four bits, the 
largest positive integer that can be represented is 7, and the most negative integer is 
-8. In particular, the value 9 can not be represented, which means that we cannot 
hope to obtain the correct answer to the problem 5 + 4. In fact, the result would 
appear as -7. This phenomenon is called overflow. That is, overflow is the problem 
that occurs when a computation produces a value that falls outside the range of val- 
ues that can be represented. When using two's complement notation, this might occur 
when adding two positive values or when adding two negative values. In either case, 
the condition can be detected by checking the sign bit of the answer. An overflow is 
indicated if the addition of two positive values results in the pattern for a negative 
value or if the sum of two negative values appears to be positive. 

Of course, because most computers use two's complement systems with longer 
bit patterns than we have used in our examples, larger values can be manipulated 
without causing an overflow. Today, it is common to use patterns of 32 bits for storing 
values in two's complement notation, allowing for positive values as large as 
2,147,483,647 to accumulate before overflow occurs. If still larger values are needed, 
longer bit patterns can be used or perhaps the units of measure can be changed. For 
instance, finding a solution in terms of miles instead of inches results in smaller num- 
bers being used and might still provide the accuracy required. 

The point is that computers can make mistakes. So, the person using the 
machine must be aware of the dangers involved. One problem is that computer 
programmers and users become complacent and ignore the fact that small values 
can accumulate to produce large numbers. For example, in the past it was common 
to use patterns of 16 bits for representing values in two's complement notation, 
which meant that overflow would occur when values of 2 15 = 32,768 or larger were 
reached. On September 19, 1989, a hospital computer system malfunctioned after 
years of reliable service. Close inspection revealed that this date was 32,768 days 
after January 1, 1900, and the machine was programmed to compute dates based 
on that starting date. Thus, because of overflow, September 19, 1989 produced a 
negative value- a phenomenon for which the computer's program was not designed 
to handle. 


Excess Notation 

Another method of representing integer values is excess notation. As is the case with 
two's complement notation, each of the values in an excess notation system is repre- 
sented by a bit pattern of the same length. To establish an excess system, we first select 
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Figure 1.24 An excess eight conversion table 
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Value 

pattern 

represer 

1 1 1 1 

7 

1110 

6 

1101 

5 

1100 

4 

1011 
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1010 

2 

1001 

1 

1000 

0 

0111 

-1 

0110 

- 2 

0101 

-3 

0100 

-4 

0011 

-5 

0010 

-6 

0001 

-7 

0000 

-8 


the pattern length to be used, then write down all the different bit patterns of that length 
in the order they would appear if we were counting in binary. Next, we observe that the 
first pattern with a 1 as its most significant bit appears approximately halfway through 
the list. We pick this pattern to represent zero; the patterns following this are used to 

represent 1, 2, 3 ; and the patterns preceding it are used for-1, -2, -3 The 

resulting code, when using patterns of length four, is shown in Figure 1.24. There we 
see that the value 5 is represented by the pattern 1101 and -5 is represented by 0011. 
(Note that the difference between an excess system and a two's complement system is 
that the sign bits are reversed.) 

The system represented in Figure 1.24 is known as excess eight notation. To 
understand why, first interpret each of the patterns in the code using the traditional 
binary system and then compare these results to the values represented in the 
excess notation. In each case, you will find that the binary interpretation exceeds 
the excess notation interpretation by the value 8. For example, the pattern 1100 in 
binary notation represents the value 12, but in our excess system it represents 4; 
0000 in binary notation represents 0, but in the excess system it represents negative 
8. In a similar manner, an excess system based on patterns of length five would be 
called excess 16 notation, because the pattern 10000, for instance, would be used to 
represent zero rather than representing its usual value of 16. Likewise, you may 
want to confirm that the three-bit excess system would be known as excess four 
notation (Figure 1.25). 
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Figure 1.25 An excess notation system using bit patterns of length three 


Bit 

Value 

pattern 

represei 

111 

3 

110 

2 

101 

1 

100 

0 

Oil 

-1 

010 

-2 

001 

-3 

000 

-4 


1 . Convert each Idxf foltoviifcill^wtfagioiTwkJsiieribiMjsre^iaitttticrB^itesetntations to its 
equivalent base ten form: 

a. 00011 b. 01111 c. 11100 

d. 11010 e. 00000 f. 10000 

2. Convert each of the follawiii^ltease tK £» representations to its equivalent two's 
complement form using patterns of eight bits: 

a. 6 b. -6 c. -17 

d. 13 e. -1 f. 0 

3 . Suppose the following bit patterns represent values stored in two's comple- 
ment notation. Find the two's complement representation of the negative of 
each value: 

a. 00000001 b. 01010101 c. 11111100 

d. 11111110 e. 00000000 f. 01111111 

4 . Suppose a machine stores numbers in two's complement notation. What are 
the largest and smallest numbers that can be stored if the machine uses bit 
patterns of the following lengths? 

a. four b. six c. eight 

5. In the following problems, each' bit pattern represents a value Stored in tWO'S 
complement notation. Find the answer to each problem in two's complement 
notation by performing the addition process described in the text. Then check 
your work by translating the problem and your answer into base ten notation, 
a. 0101 b. 0011 c. 0101 d. 1110 e. 1010 

+ ooio + f>cxoi + iiioio + mu + mo 
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6 . Solve each of the following problems in two's complement notation, but this 
time watch for overflow and indicate which answers are incorrect because 


of this phenomenon. 

a. 0100 b. 0101 

c. 1010 

d. 1010 

e. 0111 

± 0011 + ouo 

+ 1010 

+ 0111 

+ 0001 


7 Jninskuc each o! the following problems from base ten notation into two's 
complement notation using bit patterns of length four, then convert each 
problem to an equivalent addition problem (as a machine might do), and 
perform the addition. Check your answers by converting them back to base 
ten notation. 

a. 6 b. 3 c. 4 d. 2 e. 1 

- (-D z_6 - (-4) 

S. Can overflow ever occur when values are added in two's complement notation 
with one value positive and the other negative? Explain your answer. 

9 . Convert each of the following excess eight representations to its equivalent 
base ten form without referring to the table in the text: 
a. 1110 b. 0111 c. 1000 

d. 0010 e. 0000 f. 1001 

1 0 . Convert each of the following base ten representations to its equivalent 
excess eight form without referring to the table in the text: 
a. 5 b. -5 c. 3 

d. 0 e. 7 f. -8 

1 1 . Can the value 9 be represented in excess eight notation? What about repre- 
senting 6 in excess four notation? Explain your answer. 


1.7 Storing Fractions 

In contrast to the storage of integers, the storage of a value with a fractional pan 
requires that we store not only the pattern of 0s and 1 s representing its binary rep- 
resentation but also the position of the radix point. A popular way of doing this is 
based on scientific notation and is called floating-point notation. 

Floating-Point Notation 

Let us explain floating-point notation with an example using only one byte of storage. 
Although machines normally use much longer patterns, this eight-bit format is rep- 
resentative of actual systems and serves to demonstrate the important concepts with- 
out the clutter of long bit patterns. 

We first designate the high-order bit of the byte as the sign bit. Once again, a 0 in 
the sign bit will mean that the value stored is nonnegative, and a 1 will mean that the 
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value; is negative. Next, we divide the remaining seven bits of the byte into two groups, 
or fields, the exponent field and the mantissa field. Let us designate the three bits 
following the sign bit as the exponent field and the remaining four bits as the man- 
tissa field. Figure 1.26 illustrates how the byte is divided. 

We can explain the meaning of the fields by considering the following example. 
Suppose a byte consists of the bit pattern 01101011. Analyzing this pattern with the pre- 
ceding format, we see that the sign bit is 0, the exponent is 110, and the mantissa is 
1011. To decode the byte, we first extract the mantissa and place a radix point on its 
left side, obtaining 

.10 11 

Next, we extract the contents of the exponent field (110) and interpret it as an 
integer stored using the three-bit excess method (see again Figure 1.25). Thus the pat- 
tern in the exponent field in our example represents a positive 2. This tells us to move 
the radix in our solution to the right by two bits. (A negative exponent would mean 
to move the radix to the left.) Consequently, we obtain 

10.11 

which is the binary representation for 27.. Next, we note that the sign bit in our exam- 
ple is 0; the value represented is thus nonnegative. We conclude that the byte 01101011 
represents 27,. Had the pattern been 11101011 (which is the same as before except for 
the sign bit), the value represented would have been -27,. 

As another example, consider the byte 00111100. We extract the mantissa to obtain 

.1100 

and move the radix one bit to the left, since the exponent field (Oil) represents the 
value - 1 . We therefore have 

. 01100 

which represents 7.. Since the sign bit in the original pattern is 0, the value stored is 
nonnegative. We conclude that the pattern 00111100 represents Vs. 

To store a value using floating-point notation, we reverse the preceding process. 
For example, to encode 17„ first we express it in binary notation and obtain 1.001. 


Figure 1.26 Floating-point notation components 
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Next, we copy the bit pattern into the mantissa field from left to right, starting with 
the leftmost 1 in the binary representation. At this point, the byte looks like this: 

J_ 0_ 0. _1 

We must now fill in the exponent field. To this end, we imagine the contents of 
the mantissa field with a radix point at its left and determine the number of bits and 
the direction the radix must be moved to obtain the original binary number. In our 
example, we see that the radix in .1001 must be moved one bit to the right to obtain 
1.001. The exponent should therefore be a positive one, so we place 101 (which is pos- 
itive one in excess four notation as shown in Figure 1.25) in the exponent field. Finally, 
we fill the sign bit with 0 because the value being stored is nonnegative. The finished 
byte looks like this: 

0 I 0 1_ 1 0_0_1 

There is a subtle point you may have missed when filling in the mantissa field. 
The rule is to copy the bit pattern appearing in the binary representation from left: to 
right, starting with the leftmost 1. To clarify, consider the process of storing the value 
V., which is .011 in binary notation. In this case the mantissa will be 

1 1 o_o_ 

It will not be 

0 . 1 1 0 

This is because we fill in the mantissa field starting with the leftmost 1 that appears in 
the binary representation. Representations that conform to this rule are said to be in 
normalized form. 

Using normalized form eliminates the possibility of multiple representations for 
the same value. For example, both 00111100 and 01000110 would decode to the value 
V., but only the first pattern is in normalized form. Complying with normalized form 
also means that the representation for all nonzero values will have a mantissa that 
starts with 1. The value zero, however, is a special case; its floating-point representa- 
tion is a bit pattern of all 0s. 


Truncation Errors 

Let us consider the annoying problem that occurs if we try to store the value Th with 
our one-byte floating-point system. We first write 27. in binary, which gives us 10.101. 
But when we copy this into the mantissa field, we run out of room, and the rightmost 
1 (which represents the last W) is lost (Figure 1.27). If we ignore this problem for now 
and continue by filling in the exponent field and the sign bit, we end up with the bit 
pattern 01101010, which represents 2V: instead of 27». What has occurred is called a 
truncation error, or round-off error-meaning that part of the value being stored 
is lost because the mantissa field is not large enough. 

The significance of such errors can be reduced by using a longer mantissa field. 
In fact, most computers manufactured today use at least 32 bits for storing values in 
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Figure 1.27 Encoding the value 2% 
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floating-point notation instead of the 8 bits we have used here. This also allows for a 
longer exponent field at the same time. Even with these longer formats, however, 
there are still times when more accuracy is required. 

Another source of truncation errors is a phenomenon that you are already accus- 
tomed to in base ten notation: the problem of nonterminating expansions, such as 
those found when trying to express A in decimal form. Some values cannot be accu- 
rately expressed regardless of how many digits we use. The difference between our 
traditional base ten notation and binary notation is that more values have nontermi- 
nating representations in binary than in decimal notation. For example, the value 
one-tenth is nonterminating when expressed in binary. Imagine the problems this 
might cause the unwary person using floating-point notation to store and manipulate 
dollars and cents. In particular, if the dollar is used as the unit of measure, the value 
of a dime could not be stored accurately. A solution in this case is to manipulate the 
data in units of pennies so that all values are integers that can be accurately stored 
using a method such as two's complement. 

Truncation errors and their related problems are an everyday concern for people 
working in the area of numerical analysis. This branch of mathematics deals with the 
problems involved when doing actual computations that are often massive and require 
significant accuracy. 

The following is an example that would warm the heart of any numerical analyst. 
Suppose we are asked to add the following three values using our one-byte floating- 
point notation defined previously: 

2'A + '/« + % 

If we add the values in the order listed, we first add 27, to 'A and obtain 27«, which in 
binary is 10.101. Unfortunately, because this value cannot be stored accurately (as 
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seen previously), the result of our first step ends up being stored as 27 (which is 
the same as one of the values we were adding). The next step is to add this result 
to the last V.. Here again a truncation error occurs, and our final result turns out 
to be the incorrect answer 2'/,. 

Now let us add the values in the opposite order. We first add 7«to V, to obtain A. 
In binary this is .01; so the result of our first step is stored in a byte as 00111000, which 
is accurate. We now add this V* to the next value in the list, 2Va, and obtain 2 A, which 
we can accurately store in a byte as 01101011, The result this time is the correct answer. 

To summarize, in adding numeric values represented in floating-point notation, 
the order in which they are added can be important. The problem is that if a very large 
number is added to a very small number, the small number may be truncated. Thus, 
the general rule for adding multiple values is to add the smaller values together first, 
in hopes that they will accumulate to a value that is significant when added to the 
larger values. This was the phenomenon experienced in the preceding example. 

Designers of today's commercial software packages do a good job of shielding the 
uneducated user from problems such as this. In a typical spreadsheet system, cor- 
rect answers will be obtained unless the values being added differ in size by a factor 
of 10 ‘ or more. Thus, if you found it necessary to add one to the value 

10,000, 000, 000,000, 000 

you might get the answer 

10,000,000,000,000,000 

rather than 

10,000,000,000,000,001 

Such problems are significant in applications (such as navigational systems) in which 
minor errors can be compounded in additional computations and ultimately produce 
significant consequences, but for the typical PC user the degree of accuracy offered 
by most commercial software is sufficient. 

Questions 
& Exercises 

1. Decode the following bit patterns using the floating-point format discussed 

In the text: 

a. 01001010 b. 01101101 c. 00111001 d. 11011100 e. 10101011 

2. Encode the following values into the floating-point format discussed in the 

text. Indicate the occurrence of truncation errors. 

a. 2V< b. 57< c. V. d. -3 Vi e. -47. 

3. In terms of the floating-point format discussed in the text, which of the pat- 
terns 01001001 and 00111101 represents the larger value? Describe a simple 
procedure for determining which of two patterns represents the larger value. 
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4 . When using the floating-point format discussed in the text, what is the largest 
value that can be represented? What is the smallest positive value that can be 
represented? 


1.8 Data Compression 

For the purpose of storing or transferring data, it is often helpful (and sometimes 
mandatory) to reduce the size of the data involved while retaining the underlying 
information. The technique for accomplishing this is called data compression. We 
begin this section by considering some generic data compression methods and then 
look at some approaches designed for specific applications. 

Generic Data Compression Techniques 

Data compression schemes fall into two categories. Some are lossless, others are 
lossy. Lossless schemes are those that do not loose information in the compression 
process. Lossy schemes are those that may lead to the loss of information. Lossy tech- 
niques often provide more compression than lossless ones and are therefore popular 
in settings in which minor errors can be tolerated, as in the case of images and audio. 

In cases where the data being compressed consist of long sequences of the same 
value, the compression technique called run-length encoding, which is a lossless 
method, is popular. It is the process of replacing sequences of identical data ele- 
ments with a code indicating the element that is repeated and the number of times 
it occurs in the sequence. For example, less space is required to indicate that a bit pat- 
tern consists of 253 ones, followed by 118 zeros, followed by 87 ones than to actually 
list all 458 bits. 

Another lossless data compression technique is frequency-dependent encoding, 
a system in which the length of the bit pattern used to represent a data item is 
inversely related to the frequency of the item's use. Such codes are examples of vari- 
able-length codes, meaning that items are represented by patterns of different lengths 
as opposed to codes such as Unicode, in which all symbols are represented by 16 bits. 
David Huffman is credited with discovering an algorithm that is commonly used for 
developing frequency-dependent codes, and it is common practice to refer to codes 
developed in this manner as Huffman codes. In turn, most frequency-dependent 
codes in use today are Huffman codes. 

As an example of frequency-dependent encoding, consider the task of encoded 
English language text. In the English language the letters e, t, a, and i are used more 
frequently than the letters z, q, and x. So, when constructing a code for text in the Eng- 
lish language, space can be saved by using short bit patterns to represent the former 
letters and longer bit patterns to represent the latter ones. The result would be a code 
in which English text would have shorter representations than would be obtained 
with uniform-length codes. 
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In some cases, the stream of data to be compressed consists of units, each of 
which differs only slightly from the preceding one. An example would be consecutive 
frames of a motion picture. In these cases, techniques using relative encoding, also 
known as differential encoding, are helpful. These techniques record the differ- 
ences between consecutive data units rather than entire units; that is, each unit is 
encoded in terms of its relationship to the previous unit. Relative encoding can be 
implemented in either lossless or lossy form depending on whether the differences 
between consecutive data units are encoded precisely or approximated. 

Still other popular compression systems are based on dictionary encoding tech- 
niques. Here the term dictionary refers to a collection of building blocks from which 
the message being compressed is constructed, and the message itself is encoded as a 
sequence of references to the dictionary. We normally think of dictionary encoding 
systems as lossless systems, but as we will see in our discussion of image compres- 
sion, there are times when the entries in the dictionary are only approximations of 
the correct data elements, resulting in a lossy compression system. 

Dictionary encoding can be used by word processors to compress text documents 
because the dictionaries already contained in these processors for the purpose of spell 
checking make excellent compression dictionaries. In particular, an entire word can 
be encoded as a single reference to this dictionary rather than as a sequence of indi- 
vidual characters encoded using a system such as ASCII or Unicode. A typical dic- 
tionary in a word processor contains approximately 25,000 entries, which means an 
individual entry can be identified by an integer in the range ofO to 24,999. This means 
that a particular entry in the dictionary can be identified by a pattern of only 15 bits. 
In contrast, if the word being referenced consisted of six letters, its character-by-char- 
acter encoding would require 42 bits using seven-bit ASCII or 96 bits using Unicode. 

A variation of dictionary encoding is adaptive dictionary encoding (also 
known as dynamic dictionary encoding). In an adaptive dictionary encoding system, 
the dictionary is allowed to change during the encoding process. A popular exam- 
ple is Lempel-Ziv-Welsh (LZW) encoding (named after its creators, Abraham 
Lempel, Jacob Ziv, and Terry Welsh). To encode a message using LZW, one starts 
with a dictionary containing the basic building blocks from which the message is con- 
structed, but as larger units are found in the message, they are added to the dic- 
tionary-meaning that future occurrences of those units can be encoded as single, 
rather than multiple, dictionary references. For example, when encoding English 
text, one could start with a dictionary containing individual characters, digits, and 
punctuation marks. But as words in the message are identified, they could be added 
to the dictionary. Thus, the dictionary would grow as the message is encoded, and 
as the dictionary grows, more words (or recurring patterns of words) in the message 
could be encoded as single references to the dictionary. 

The result would be a message encoded in terms of a rather large dictionary that 
is unique to that particular message. But this large dictionary would not have to be 
present to decode the message. Only the original small dictionary would be needed. 
Indeed, the decoding process could begin with the same small dictionary with which 
the encoding process started. Then, as the decoding process continues, it would 
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encounter the same units found during the encoding process, and thus be able to add 
them to the dictionary for future reference just as in the encoding process. 

To clarify, consider applying LZW encoding to the message 

xyx xyx xyx xyx 

starting with a dictionary with three entries, the first being x, the second being y, and 
the third being a space. We would begin by encoding xyx as 121, meaning that the 
message starts with the pattern consisting of the first dictionary entry, followed by the 
second, followed by the first. Then the space is encoded to produce 1213. But, having 
reached a space, we know that the preceding string of characters forms a word, and 
so we add the pattern xyx to the dictionary as the fourth entry. Continuing in this 
manner, the entire message would be encoded as 121343434. 

If we were now asked to decode this message, starting with the original three- 
entry dictionary, we would begin by decoding the initial string 1213 as xyx followed 
by a space. At this point we would recognize that the string xyx forms a word and add 
it to the dictionary as the fourth entry, just as we did during the encoding process. We 
would then continue decoding the message by recognizing that the 4 in the message 
refers to this new fourth entry and decode it as the word xyx , producing the pattern 

xyx xyx 

Continuing in this manner we would ultimately decode the string 121343434 as 
xyx xyx xyx xyx 
which is the original message. 

Compressing Images 

In Section 1.4, we saw how images are encoded using bit map techniques. Unfortu- 
nately, the bit maps produced are often very large. In turn, numerous compression 
schemes have been developed specifically for image representations. 

One system known as GIF (short for Graphic Interchange Format and pro- 
nounced "GifP by some and "Jiff by others) is a dictionary encoding system that 
was developed by CompuServe. It approaches the compression problem by reducing 
the number of colors that can be assigned to a pixel to only 256. The red-green-blue 
combination for each of these colors is encoded using three bytes, and these 256 
encodings are stored in a table (a dictionary) called the palette. Each pixel in an 
image can then be represented by a single byte whose value indicates which of the 
256 palette entries represents the pixel's color. (Recall that a single byte can contain 
any one of 256 different bit patterns.) Note that GIF is a lossy compression system 
when applied to arbitrary images because the colors in the palette may not be iden- 
tical to the colors in the original image. 

GIF can obtain additional compression by extending this simple dictionary system 
to an adaptive dictionary system using LZW techniques. In particular, as patterns of 
pixels are encountered during the encoding process, they are added to the dictionary 
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so that future occurrences of these patterns can be encoded more efficiently. Thus, the 
final dictionary consists of the original palette and a collection of pixel patterns. 

One of the colors in a GIF palette is normally assigned the value "transparent," 
which means that the background is allowed to show through each region assigned that 
"color." This option, combined with the relative simplicity of the GIF system, makes 
GIF a logical choice in simple animation applications in which multiple images must 
move around on a computer screen. On the other hand, its ability to encode only 256 
colors renders it unsuitable for applications in which higher precision is required, as 
in the field of photography. 

Another popular compression system for images is JPEG (pronounced "JAY-peg"). 
It is a standard developed by the Joint Photographic Experts Group (hence the 
standard's name) within ISO. JPEG has proved to be an effective standard for com- 
pressing color photographs and is widely used in the photography industry, as wit- 
nessed by the fact that most digital cameras use JPEG as their default compression 
technique. 

The JPEG standard actually encompasses several methods of image compres- 
sion, each with its own goals. In those situations that require the utmost in precision, 
JPEG provides a lossless mode. However, JPEG's lossless mode does not produce high 
levels of compression when compared to other JPEG options. Moreover, other JPEG 
options have proven very successful, meaning that JPEG's lossless mode is rarely 
used. Instead, the option known as JPEG's baseline standard (also known as JPEG's 
lossy sequential mode) has become the standard of choice in many applications. 

Image compression using the JPEG baseline standard requires a sequence of 
steps, some of which are designed to take advantage of a human eye's limitations. In 
particular, the human eye is more sensitive to changes in brightness than to changes 
in color. So, starting from an image that is encoded in terms of luminance and chromi- 
nance components, the first step is to average the chrominance values over two-by- 
two pixel squares. This reduces the size of the chrominance information by a factor 
of four while preserving all the original brightness information. The result is a sig- 
nificant degree of compression without a noticeable loss of image quality. 

The next step is to divide the image into eight-by-eight pixel blocks and to com- 
press the information in each block as a unit. This is done by applying a mathematical 
technique known as the discrete cosine transform, whose details need not concern us 
here. The important point is that this transformation converts the original eight-by- 
eight block into another block whose entries reflect how the pixels in the original 
block relate to each other rather than the actual pixel values. Within this new block, 
values below a predetermined threshold are then replaced by zeros, reflecting the 
fact that the changes represented by these values are too subtle to be detected by the 
human eye. For example, if the original block contained a checker board pattern, the 
new block might reflect a uniform average color. (A typical eight-by-eight pixel block 
would represent a very small square within the image so the human eye would not 
identify the checkerboard appearance anyway.) 

At this point, more traditional run-length encoding, relative encoding, and vari- 
able-length encoding techniques are applied to obtain additional compression. All 
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together, JPEG's baseline standard normally compresses color images by a factor of 
at least 10, and often by as much as 30, without noticeable loss of quality. 

Still another data compression system associated with images is TIFF (short for 
Tagged Image File Format). However, the most popular use of TIFF is not as a means 
of data compression but instead as a standardized format for storing photographs 
along with related information such as date, time, and camera settings. In this con- 
text, the image itself is normally stored as red, green, and blue pixel components 
without compression. 

The TIFF collection of standards does include data compression techniques, most 
of which are designed for compressing images of text documents in facsimile appli- 
cations. These use variations of run-length encoding to take advantage of the fact that 
text documents consist of long strings of white pixels. The color image compression 
option included in the TIFF standards is based on techniques similar to those used by 
GIF, and are therefore not widely used in the photography community. 

Compressing Audio and Video 

The most popularly known standards for encoding and compressing audio and video 
were developed by the Motion Picture Experts Group (MPEG) under the leader- 
ship of ISO. In turn, these standards themselves are called MPEG. 

MPEG encompasses a variety of standards for different applications. For example, 
the demands for high definition television (HLTTV) broadcast are distinct from those 
for video conferencing in which the broadcast signal must find its way over a variety 
of communication paths that may have limited capabilities. And, both of these appli- 
cations differ from that of storing video in such a manner that sections can be replayed 
or skipped over. 

The techniques employed by MPEG are well beyond the scope of this text, but in 
general, video compression techniques are based on video being constructed as a 
sequence of pictures in much the same way that motion pictures are recorded on 
film. To compress such sequences, only some of the pictures, called I-frames, are 
encoded in their entirety. The pictures between the I-frames are encoded using rel- 
ative encoding techniques. That is, rather than encode the entire picture, only its dis- 
tinctions from the prior image are recorded. The I-frames themselves are usually 
compressed with techniques similar to JPEG. 

The best known system for compressing audio is MP3, which was developed 
within the MPEG standards. In fact, the acronym MP3 is short for MPEG layer 3. 
Among other compression techniques, MP3 takes advantage of the properties of the 
human ear removing those details that the human ear cannot perceive. One such 
property, called temporal masking, is that for a short period after a loud sound, the 
human ear cannot detect softer sounds that would otherwise be audible. Another, 
called frequency masking, is that a sound at one frequency tends to mask softer 
sounds at nearby frequencies. By taking advantage of such characteristics, MP3 can 
be used to obtain significant compression of audio while maintaining near CD qual- 
ity sound. 
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Using MPEG and MP3 compression techniques, video cameras are able to record 
as much as an hour's worth of video within 128MB of storage and portable music play- 
ers can Store as many as 400 popular songs in a single GB. But, in contrast to the goals 
of compression in other settings, the goal of compressing audio and video is not nec- 
essarily to save storage space. Just as important is the goal of obtaining encodings that 
allow information to be transmitted over today's communication systems fast enough 
to provide timely presentation. If each video frame required a MB of storage and the 
frames had to be transmitted over a communication path that could relay only one 
KB per second, there would be no hope of successful video conferencing. Thus, in 
addition to the quality of reproduction allowed, audio and video compression systems 
are oftenjudged by the transmission speeds required for timely data communication. 
These speeds are normally measured in bits per second (bps). Common units 
include Kbps (kilo-bps, equal to 1000 bps), Mbps (mega-bps, equal to 1 million bps), and 
Gbps (giga-bps, equal to 1 billion bps). Using MPEG techniques, video presentations 
can be successfully relayed over communication paths that provide transfer rates of 40 
Mbps. MP3 recordings generally require transfer rates of no more than 64 Kbps. 


Questions 
& Exercises 


1 - List four generic compression techniques. 

2 What would be the encoded version of the message 
xyx yxxxy xyx yxxxy yxxxy 

ifLZW compression, starting with the dictionary containing x, y, and a space 
(as described in the text), were used? 

3 . Why would GIF be better than JPEG when encoding color cartoons? 

4. Suppose you were part of a team designing a spacecraft that will travel to 
other planets and send back photographs. Would it be a good idea to com- 
press the photographs using GIF or JPEG's baseline standard to reduce the 
resources required to store and transmit the images? 

5. What characteristic of the human eye does JPEG's baseline standard exploit? 

6. What characteristic of the human ear does MP3 exploit? 

7 identify a troubling phenomenon that is common when encoding numeric 
information, images, and sound as bit patterns. 


1.9 Communication Errors 

When information is transferred back and forth among the various parts of a computer, 
or transmitted from the earth to the moon and back, or, for that matter, merely left in 
storage, a chance exists that the bit pattern ultimately retrieved may not be identical to 
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the original one. Particles of dirt or grease on a magnetic recording surface or a mal- 
functioning circuit may cause data to be incorrectly recorded or read. Static on a trans- 
mission path may corrupt portions of the data. And, in the case of some technologies, 
normal background radiation can alter patterns stored in a machine's main memory. 

To resolve such problems, a variety of encoding techniques have been developed 
to allow the detection and even the correction of errors. Tbday, because these tech- 
niques are largely built into the internal components of a computer system, they are 
not apparent to the personnel using the machine. Nonetheless, their presence is 
important and represents a significant contribution to scientific research. It is fitting, 
therefore, that we investigate some of these techniques that lie behind the reliability 
of today’s equipment. 

Parity Bits 

A simple method of detecting errors is based on the principle that if each bit pattern 
being manipulated has an odd number of Is and a pattern with an even number of 
Is is encountered, an error must have occurred. To use this principle, we need an 
encoding system in which each pattern contains an odd number of Is. This is easily 
obtained by first adding an additional bit, called a parity bit, to each pattern in an 
encoding system already available (perhaps at the high-order end). In each case, we 
assign the value 1 or 0 to this new bit so that the entire resulting pattern has an odd 
number of 1 s. Once our encoding system has been modified in this way, a pattern with 
an even number of Is indicates that an error has occurred and that the pattern being 
manipulated is incorrect. 

Figure 1.28 demonstrates how parity bits could be added to the ASCII codes for the 
letters A and F. Note that the code for Abecomes 101000001 (parity bit 1) and the ASCII 
for Fbecomes 001000110 (parity bit 0). Although the original eight-bit pattern for A has 
an even number of Is and the original eight-bit pattern for F has an odd number of 1 s, 
both the nine-bit patterns have an odd number of 1 s. If this technique were applied to 
all the eight-bit ASCII patterns, we would obtain a nine-bit encoding system in which 
an error would be indicated by any nine-bit pattern with an even number of Is. 

The parity systemjust described is called odd parity, because we designed our 
system so that each correct pattern contains an odd number of Is. Another technique 


Figure 1.28 The ASCII codes for the letters A and F adjusted for odd parity 
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is called even parity. In an even parity system, each pattern is designed to contain 
an even number of Is, and thus an error is signaled by the occurrence of a pattern with 
an odd number of Is. 

Today it is not unusual to find parity bits being used in a computer's main mem- 
ory. Although we envision these machines as having memory cells of eight-bit capac- 
ity, in reality each has a capacity of nine bits, one bit of which is used as a parity bit. 
Each time an eight-bit pattern is given to the memory circuitry for storage, the circuitry 
adds a parity bit and stores the resulting nine-bit pattern. When the pattern is later 
retrieved, the circuitry checks the parity of the nine-bit pattern. If this does not indi- 
cate an error, then the memory removes the parity bit and confidently returns the 
remaining eight-bit pattern. Otherwise, the memory returns the eight data bits with 
a warning that the pattern being returned may not be the same pattern that was orig- 
inally entrusted to memory. 

The straightforward use of parity bits is simple but it has its limitations. If a pattern 
originally has an odd number of 1 s and suffers two errors, it will still have an odd num- 
ber of 1 s, and thus the parity system will not detect the errors. In fact, straightforward 
applications of parity bits fail to detect any even number of errors within a pattern. 

One means of minimizing this problem is sometimes applied to long bit patterns, 
such as the string of bits recorded in a sector on a magnetic disk. In this case the pat- 
tern is accompanied by a collection of parity bits making up a checkbyte. Each bit 
within the checkbyte is a parity bit associated with a particular collection of bits scat- 
tered throughout the pattern. For instance, one parity bit maybe associated with every 
eighth bit in the pattern starting with the first bit, while another may be associated with 
every eighth bit starting with the second bit. In this manner, a collection of errors con- 
centrated in one area of the original pattern is more likely to be detected, since it will 
be in the scope of several parity bits. Variations of this checkbyte concept lead to error 
detection schemes known as checksums and cyclic redundancy checks (CRC). 

Error-Correcting Codes 

Although the use of a parity bit allows the detection of an error, it does not provide 
the information needed to correct the error. Many people are surprised that error-cor- 
recting codes can be designed so that errors can be not only detected but also cor- 
rected. After all, intuition says that we cannot correct errors in a received message 
unless we already know the information in the message. However, a simple code with 
such a corrective property is presented in Figure 1.29. 

To understand how this code works, we first define the Hamming distance 
(named after R. W Hamming, who pioneered the search for error-correcting codes 
after becoming frustrated with the lack of reliability of the early relay machines of the 
1940s) between two patterns to be the number of bits in which the patterns differ. 
For example, the Hamming distance between the patterns representing A and B in the 
code in Figure 1.29 is four, and the Hamming distance between B and C is three. The 
important feature of the code in Figure 1.29 is that any two patterns are separated by 
a Hamming distance of at least three. 
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Figure 1.29 An error-correcting code 


Symbol Code 

A 000000 
B 001111 
C 010011 
D 011100 
E 100110 
F 101001 
G 110101 
H 111010 


If a single bit is modified in a pattern from Figure 1.29, the error can be detected 
since the result will not be a legal pattern. (We must change at least three bits in any 
pattern before it will look like another legal pattern.) Moreover, we can also figure 
out what the original pattern was. After all, the modified pattern will be a Hamming 
distance of only one from its original form but at least two from any of the other 
legal patterns. 

Thus, to decode a message that was originally encoded using Figure 1.29, we sim- 
ply compare each received pattern with the patterns in the code until we find one that 
is within a distance of one from the received pattern. We consider this to be the cor- 
rect symbol for decoding. For example, if we received the bit pattern 010100 and com- 
pared this pattern to the patterns in the code, we would obtain the table in Figure 
1.30. Thus, we would conclude that the character transmitted must have been a D 
because this is the closest match. 


Figure 1.30 Decoding the pattern 010100 using the code in Figure 1.29 


Character 


Code 



Pattern 

received 

Distance between 
received pattern 
and code 

A 

0 

0 0 0 0 

0 

0 

1 0 

1 
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2 

B 

0 

0 111 

1 

0 

1 0 

1 
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4 

C 

0 

10 0 1 
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0 

1 0 

1 

0 0 

3 

D 

0 

1110 

0 

0 

1 0 

1 

o 0 

1 — Smallest 

E 

1 

0 0 11 

0 

0 

1 0 

1 

o 0 

distance 

F 
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0 10 0 

1 

0 

1 0 

1 

0 0 

5 

G 

1 

10 10 

1 

0 

1 0 

1 

0 0 

2 

H 

1 

110 1 

0 

0 

1 0 

1 

0 0 

4 
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You will observe that using this technique with the code in Figure 1.29 actually 
allows us to detect up to two errors per pattern and to correct one error. If we designed 
the code so that each pattern was a Hamming distance of at least five from each of 
the others, we would be able to detect up to four errors per pattern and correct up to 
two. Of course, the design of efficient codes associated with large Hamming distances 
is not a straightforward task. In fact, it constitutes a part of the branch of mathematics 
called algebraic coding theory, which is a subject within the fields of linear algebra and 
matrix theory. 

Error-correcting techniques are used extensively to increase the reliability of com- 
puting equipment. For example, they are often used in high-capacity magnetic disk 
drives to reduce the possibility that flaws in the magnetic surface will corrupt data. 
Moreover, a major distinction between the original CD format used for audio disks and 
the later format used for computer data storage is in the degree of error correction 
involved. CD-DA format incorporates error-correcting features that reduce the error 
rate to only one error for two CDs. This is quite adequate for audio recordings, but a 
company using CDs to supply software to customers would find that flaws in 50 per- 
cent of the disks would be intolerable. Thus, additional error-correcting features are 
employed in CDs used for data storage, reducing the probability of error to one in 
20,000 disks. 


Questions 
& Exercises 


1 The following bytes were originally encoded using odd parity. In which of 
them do you know that an error has occurred? 

a. 10101101 b. 10000001 c. 00000000 d. 11100000 e. 11111111 

2 Could errors have occurred in a byte from Question 1 without your knowing 
it? Explain your answer. 

3 How would your answers to Questions 1 and 2 change if you were told that 
even parity had been used instead of odd? 

4. Encode these sentences in ASCII using odd parity by adding a parity bit at 
the high-order end of each character code: 

a. Where are you? 

b. "How?" Cheryl asked. 

c. 2 + 3=5. 

5. Using the error-correcting code presented in Figure 1.30, decode the follow- 
ing messages: 

a. 001111 100100 001100 

b. 010001 000000 001011 

c. 011010 110110 100000 011100 

6 - Construct a code for the characters A, B, C, and D using bit patterns of length 
five so that the Hamming distance between any two patterns is at least three. 


Chapter Review Problems 87 


Chapter Review Problems 

(Asterisked problems are associated with optional sections.) 


1 . Determine the output of each of the following 
circuits, assuming that the upper input is 1 
and the lower input is 0. 


> 

a. 




b. 



2. For each of the following circuits, identify the 
input combinations that produce an output of 1 . 


3. in each circuit below, the rectangles represent 
the same type of gate. Based on the input and 
output information given, identify whether 
the gate involved is an AND , OR, or XOR. 



> 


> — 1 1 



-> 


> 

>- 






> 




[ > o J 


c. 

4, Assume that both of the inputs in the circuit 
below are 1. Describe what would happen if 
the upper input were temporarily changed to 
0. Describe what would happen if the lower 
input were temporarily changed to 0. Redraw 
the circuit using NAND gates. 
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5 The following table represents the addresses 
and contents (using hexadecimal notation) of 
some cells in a machine's main memory. 
Starting with this memory arrangement, follow 
the sequence of instructions and record the 
final contents of each of these memory cells; 


ddress 

Contents 

00 

AB 

01 

53 

02 

D6 

03 

02 


Step 1. Move the contents of the cell whose 
address is 03 to the cell at address 00. 
Step 2. Move the value 01 into the cell at 
address 02. 

Step 3. Move the value stored at address 01 
into the cell at address 03. 

6 . How many cells can be in a computer’s main 
memory if each cell's address can be repre- 
sented by two hexadecimal digits? What if four 
hexadecimal digits are used? 

1 - What bit patterns are represented by the fol- 
lowing hexadecimal notations? 

a. CB b. 67 c. A9 d. 10 e. FF 

8. what is the value of the most significant bit in 
the bit patterns represented by the following 
hexadecimal notations? 
a. 7F b. FF c. 8F d. IF 


of each pixel, how many byte-size memory 
cells are required to hold the entire picture? 

1 2. a . Identify two advantages that main memory 
has over magnetic disk storage. 

b. Identify two advantages that magnetic disk 
storage has over main memory. 

1 3 . Suppose that only 50GB of your personal com- 
puter's 120GB hard-diskdrive is empty. Would 
it be reasonable to use CDs to store all the 
material you have on the drive as a backup? 
What about DVDs? 

14. If each sector on a magnetic disk contains 
1024 bytes, how many sectors are required to 
store a single page of text (perhaps 50 lines of 
100 characters) if each character is repre- 
sented in Unicode? 

1 5. How many bytes of storage space would be 
required to store a 400-page novel in which 
each page contains 3500 characters if ASCII 
were used? How many bytes would be 
required if Unicode were used? 

16- How long is the latency time of a typical hard- 
disk drive spinning at 60 revolutions per 
second? 

17. What is the average access time for a hard disk 
spinning at 60 revolutions per second with a 
seek time of 10 milliseconds? 


9. Express the following bit patterns in hexadeci- 
mal notation: 

a. 101010101010 

b. 110010110111 

c. 000011101011 

1 0. Suppose a digital camera has a storage capac- 
ity of 256MB. How many photographs could 
be stored in the camera if each consisted of 
1024 pixels per row and 1024 pixels per col- 
umn if each pixel required three bytes of 
storage? 

11- Suppose a picture is represented on a computer 
screen by a rectangular array containing 1024 
columns and 768 rows of pixels. If eight bits 
are required to encode the color and intensity 


1 8 . Suppose a typist could type 60 words per 

minute continuously day after day. How long 
would it take the typist to fill a CD whose 
capacity is 640MB? Assume one word is five 
characters and each character requires one 
byte of storage. 


1 9- Here is a message in ASCII. What does it say? 
01010111 01101000 01100001 01110100 
00100000 01100100 

01101111 01100101 01110011 00100000 
01101001 01110100 

00100000 01110011 01100001 01111001 
00111111 


20. The following is a message encoded in ASCII 
using one byte per character and then repre- 
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sented in hexadecimal notation. What is the 
message? 

6S65786 1 646563696D6 1 6C 

2 1 . Encode the following sentences in ASCII using 
one byte per character. 

a. 100/5- 20 

b. To be or not to be? 

c. The total cost is $7.25. 

22. Express your answers to the previous problem 
in hexadecimal notation. 

23. List the binary representations of the integers 
from 6 to 16. 


24 ■ a. Write the number 26 by representing the 2 
and 6 in ASCII. 

b. Write the number 26 in binary 
representation. 


25. What values have binary representations in 
which only one of the bits is 1? List the binary 
representations for the smallest six values 
with this property. 


*2b. 


Convert each of the following binary represen- 
tations to its equivalent base ten representation 


a. I 1 1 
d. 10001 
g. 100 
j. 11001 


b. 0001 
e, 10011 
h. 1000 
k. 11010 


c. 10101 
f. 000000 
i. 10000 
1. 11011 


*27. Convert each of the following base ten repre- 
sentations to its equivalent binary repre- 
sentation: 

a. 7 b. II c. 16 

d. 15 g ; 33 

* 28 - Convert each of the following excess 16 repre- 
sentations to its equivalent base ten represen- 
tation: 

a. 10000 b. 10011 c. 01101 

d. 01111 e. 10111 


*30. Convert each of the following two's comple- 
ment representations to its equivalent base 
ten representation: 
a. 01111 b. 10011 c. 01101 

d. 10000 e. 10111 

*31. Convert each of the following base ten repre- 
sentations to its equivalent two's complement 
representation in which each value is repre- 
sented in seven bits: 
a. 12 b. -12 c. -1 

d. 0 e. 8 

*32. Perform each of the following additions 

assuming the bit strings represent values in 
two's complement notation. Identify each case 
in which the answer is incorrect because of 
overflow. 


a. 

00101 

b. 11111 

c. 

01111 


+01000 

+00001 


+00001 

d. 

10111 

e. 00111 

f. 

00111 


+11010 

+00111 


+01100 

g- 

11111 

h. 01010 

i. 

01000 

+11111 

+00011 


+01000 


j . 01010 

t i o i o I 

*33. Solve each of the following problems by trans- 
lating the values into two's complement nota- 
tion (using patterns of five bits), converting 
any subtraction problem to an equivalent addi- 
tion problem, and performing that addition. 
Check your work by converting your answer 
to base ten notation. (Watch out for overflow.) 
a. 7 b. 7 c. 12 

_i_ j a - 4 

d. 8 e. 12 f. 5 

- 7 + 4 + 11 


* 29 > Convert each of the following base ten repre- 
sentations to its equivalent excess four repre- 
sentation: 

a. 0 b. 3 c. -3 

d. -1 e. 1 


*34. Convert each of the following binary repre- 
sentations into its equivalent base ten 
representation: 

a. 11.01 b. 100.0101 c. 0.1101 

d. 1.0 e. 10.001 
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*35. Express each of the following values in binary 
notation: 

a. §'/< b. / m c . 77a 

d. 17* e. 67; 

*36. Decode the following bit patterns using the 
floating-point format described in Figure 1.26: 

a. 01011010 b. 11001000 

c. 00101100 d. 10111001 

*37 Encode the following values using the eight-bit 
floating-point format described in Figure 1.26. 
Indicate each case in which a truncation error 
occurs. 

a. 7i b. 77 2 c. -37< 

d. 7a e. » / » 

*38. Assuming you are not restricted to using nor- 
malized form, list all the bit patterns that could 
be used to represent the value 7a using the 
floating-point format described in Figure 1.26. 

*39. what is the best approximation to the square 
root of 2 that can be expressed in the eight-bit 
floating-point format described in Figure 1.26? 
What value is actually obtained if this approxi- 
mation is squared by a machine using this 
floating-point format? 

*40. what is the best approximation to the value 
one-tenth that can be represented using the 
eight-bit floating-point format described in 
Figure 1.26? 

*41. Explain how errors can occur when measure- 
ments using the metric system are recorded in 
floating-point notation. For example, what if 
110 cm was recorded in units of meters? 

*42 Using the eight-bit floating-point format 

described in Figure 1.26, what would be the 
result of computing the sum 7s + 7a + 7a + 

27z from left to right? How about from right to 
left? 

*43. what answer would be given to each of the fol- 
lowing problems by a machine using the eight- 
bit floating-point format described in Figure 
1.26? 

a. V/i + 7u = 


b. 37, + 17= = 

c. 274 + 17a = 

*44 In each of the following addition problems, 
interpret the bit patterns using the eight-bit 
floating-point format presented in Figure 1.26, 
add the values represented, and encode the 
answer in the same floating-point format. 
Identify those cases in which truncation errors 
occur. 


a. 01011100 

b. 

01011000 

+01101000 


+01011000 

c. 01111000 

d. 

01101010 

+00011000 


+00111000 


'45. One of the bit patterns 01011 and 11011 repre- 
sents a value stored in excess 16 notation and 
the other represents the same value stored in 
two's complement notation. 

a. What can be determined about this com- 
mon value? 

b. What is the relationship between a pattern 
representing a value stored in two's comple- 
ment notation and the pattern representing 
the same value stored in excess notation 
when both systems use the same bit pat- 
tern length? 

*46. The three bit patterns 01101000, 10000010, and 
00000010 are representations of the same 
value in two's complement, excess, and the 
eight-bit floating-point format presented in 
Figure 1.26, but not necessarily in that order. 
What is the common value, and which pattern 
is in which notation? 

*47 in each of the following cases, the different 
bit strings represent the same value but in 
different numeric encoding systems that we 
have discussed. Identify each value and the 
encoding systems used to represent it. 

a. 11111010 0011 1011 

b. 11111101 01111101 11101100 

c. 1010 0010 01101000 

"48. Which of the following bit patterns are not 

valid representations in an excess 16 notation 
system? 
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a. 01001 b. 101 c. 010101 

d. 00000 e. 1000 f. 000000 

g. mi 

* 49 . Which of the following values cannot be repre- 
sented accurately in the floating-point format 
introduced in Figure 1.26? 
a. 6V2 b. 9 c. 'Vie 

d. "hi e. 'Vifi 

* 50 . If you doubled the length of the bit strings 
being used to represent integers in binary 
from four bits to eight bits, what change would 
be made in the value of the largest integer you 
could represent? What if you were using two's 
complement notation? 

*51 . What would be the hexadecimal representa- 
tion of the largest memory address in a mem- 
ory consisting of 4MB if each cell had a 
one-byte capacity? 

*52. Using gates, design a circuit with four inputs 
and one output such that the output is 1 or 0 
depending on whether the four-bit input pat- 
tern has odd or even parity, respectively. 

* 53 . what would be the encoded version of the 
message 

xxy y y x xxy xxy y y x 

if LZW compression, starting with the diction- 
ary containing x, y t and a space (as described 
in Section 1 . 8 ), were used? 

* 54 . The following message was compressed using 
LZW compression with a dictionary whose 
first, second, and third entries are x, y, and 
space, respectively. What is the decompressed 
message? 

22123113431213536 

* 55 . If the message 

xxy yyx xxy xxyy 

were compressed using LZW with a starting 
dictionary whose first, second, and third 


entries were x, y, and space, respectively, what 
would be the entries in the final dictionary? 

* 56 . As we will learn in the next chapter, one 
means of transmitting bits over traditional 
telephone systems is to convert the bit pat- 
terns into sound, transfer the sound over the 
telephone lines, and then convert the sound 
back into bit patterns. Such techniques are 
limited to transfer rates of 57.6 Kbps. Is this 
sufficient for teleconferencing if the video is 
compressed using MPEG? 

" 57 . Encode the following sentences in ASCII using 
one byte per character. Use the most signifi- 
cant bit of each byte as an (odd) parity bit. 

a. 100/5 = 20 

b. To be or not to be? 

c. The total cost is $7.25. 

*58 . The following message was originally trans- 
mitted with odd parity in each short bit string. 
In which strings have errors definitely 
occurred? 

1 1 001 1 1 01 1 1 01 1 0 00000 1 1 1 1 1 10 0 01 

10101 00100 01 1 1 0 

* 59 . Suppose a 24-bit code is generated by repre- 
senting each symbol by three consecutive 
copies of its ASCII representation (for exam- 
ple, the symbol A is represented by the bit 
string 010000010100000101000001). What error- 
correcting properties does this new code have? 
* 60 . Using the error-correcting code described in 
Figure 1.30, decode the following words: 

a. 111010 110110 

b. 101000 100110 001100 

c. 011101 000110 000000 010100 

d. 010010 001000 001110 101111 

000000 110111 100110 

e. 010011 000000 101001 100:1c 
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Social Issues 


The following questions are intended as a guide to the ethical/social/legal issues asso- 
ciated with the field of computing. The goal is not merely to answer these questions. 
You should also consider why you answered as you did and whether your justifications 
are consistent from one question to the next. 

1 . A truncation error has occurred in a critical situation, causing extensive dam- 
age and loss of life. Who is liable, if anyone? The designer of the hardware? 
The designer of the software? The programmer who actually wrote that part 
of the program? The person who decided to use the software in that particular 
application? What if the software had been corrected by the company that 
originally developed it, but that update had not been purchased and applied 
in the critical application? What if the software had been pirated? 

2. Is it acceptable for an individual to ignore the possibility of truncation errors 
and their consequences when developing his or her own applications? 

3. Was it ethical to develop software in the 1970s using only two digits to repre- 
sent the year (such as using 76 to represent the year 1976), ignoring the fact 
that the software would be flawed as the turn of the century approached? Is it 
ethical today to use only three digits to represent the year (such as 982 for 
1982 and 015 for 2015)? What about using only four digits? 

4. Many argue that encoding information often dilutes or otherwise distorts the 
information, since it essentially forces the information to be quantified. They 
argue that a questionnaire in which subjects are required to record their opin- 
ions by responding within a scale from one to five is inherently flawed. To 
what extent is information quantifiable? Can the pros and cons of different 
locations for a waste disposal plant be quantified? Is the debate over nuclear 
power and nuclear waste quantifiable? Is it dangerous to base decisions on 
averages and other statistical analysis? Is it ethical for news agencies to report 
polling results without including the exact wording of the questions? Is it pos- 
sible to quantify the value of a human life? Is it acceptable for a company to 
stop investing in the improvement of a product, even though additional 
investment could lower the possibility of a fatality relating to the product's 
use? 

5. With the development of digital cameras, the ability to alter or fabricate pho- 
tographs is being placed within the capabilities of the general public. What 
changes will this bring to society? What ethical and legal issues could arise? 

6. Should there be a distinction in the rights to collect and disseminate data 
depending on the form of the data? That is, should the right to collect and dis- 
seminate photographs, audio, or video be the same as the right to collect and 
disseminate text? 

7. Whether intentional or not, a report submitted by a journalist usually reflects 
that journalist's bias. Often by changing only a few words, a story can be 
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given either a positive or negative connotation. (Compare, "The majority of 
those surveyed opposed the referendum." to "A significant portion of those 
surveyed supported the referendum.") Is there a difference between altering a 
story (by leaving out certain points or carefully selecting words) and altering 
a photograph? 

8 . Suppose that the use of a data compression system results in the loss of subtle 
but significant items of information. What liability issues might be raised? 
How should they be resolved? 
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In this chapter we will learn how a com- 
puter manipulates data and c o m m u n i 
cates with peripheral devices such as 
printers and keyboards. In doing so, we 
will explore the basics of computer archi- 
tecture and learn how computers are 
programmed by means of encoded 
instructions, called machine language 
instructions. 
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Data Manipulation 


In Chapter 1 we studied topics relating to the storage of data inside a computer. In 
this chapter we will see how a computer manipulates that data. This manipulation 
consists of moving data from one location to another as well as performing opera- 
tions such as arithmetic calculations, text editing, and image manipulation. We begin 
by extending our understanding of computer architecture beyond that of data stor- 
age systems. 


2.1 Computer Architecture 

The circuitry in a computer that controls the manipulation of data is called the cen- 
tra! processing unit, or CPU (often referred to as merely the processor). In the 
machines of the mid-twentieth century, CPUs were large units composed of perhaps 
several racks of electronic circuitry that reflected the significance of the unit. How- 
ever, technology has shrunk these devices drastically. The CPUs found in today’s PCs 
(such as the Pentium and Celeron processors made by Intel or the Athlon and Sem- 
pron processors made by AMD) are packaged as small flat squares (approximately 
two inches by two inches) whose connecting pins plug into a socket mounted on the 
machine's main circuit board (called the motherboard). 

A CPU consists of two parts: the arithmetic/logic unit, which contains the cir- 
cuitry that performs operations on data (such as addition and subtraction), and the 
control unit, which contains the circuitry for coordinating the machine's activities. 
For temporary storage of information, the CPU contains cells, or registers, that are 
conceptually similar to main memory cells. These registers can be classified as either 
general-purpose registers or special-purpose registers. We will discuss some of the 
special-purpose registers in Section 2.3. For now, we are concerned only with the gen- 
eral-purpose registers. 

General-purpose registers serve as temporary holding places for data being manip- 
ulated by the CPU. These registers hold the inputs to the arithmetic/logic unit's cir- 
cuitry and provide storage space for results produced by that unit. To perform an 
operation on data stored in main memory, the control unit transfers the data from 
memory into the general-purpose registers, informs the arithmetic/logic unit which 
registers hold the data, activates the appropriate circuitry within the arithmetic/logic 
unit, and tells the arithmetic/logic unit which register should receive the result. 

For the purpose of transferring bit patterns, a machine's CPU and main memory 
are connected by a collection of wires called a bus (Figure 2.1). Through this bus, the 
CPU extracts (reads) data from main memory by supplying the address of the perti- 
nent memory cell along with an electronic signal telling the memory circuitry that it 
is supposed to retrieve the data in the indicated cell. In a similar manner, the CPU 
places (writes) data in memory by providing the address of the destination cell and 
the data to be stored together with the appropriate electronic signal telling main mem- 
ory that it is supposed to store the data being sent to it. 

Based on this design, the task of adding two values stored in main memory 
involves more than the mere execution of the addition operation. Indeed, the complete 
process of adding two values stored in memory is summarized by the five steps listed 
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Figure 2.1 CPU and main memory connected via a bus 
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in Figure 2.2. In short, the data must be transferred from main memory to registers 
within the CPU, the values must be added with the result being placed in a register, 
and the result must then be stored in a memory cell. 

Early computers were not known for their flexibility-the steps that each device 
executed were built into the control unit as a part of the machine. To gain more flex- 
ibility, some of the early electronic computers were designed so that the control unit 
could be conveniently rewired. This flexibility was accomplished by means of a peg- 
board arrangement similar to old telephone switchboards in which the ends of jumper 
wires were plugged into holes. 


Figure 2.2 Adding values stored in memory 


Step 1. Get one ofthe values to be 
added from memory and 
place it in a register. 

Step 2. Get the other value to be 
added from memory and 
place it in another register. 

Step 3. Activate the addition circuitry 
with the registers used in 
Steps 1 and 2 as inputs and 
another register designated 
to hold the result. 

Step 4. Store the result in memory. 


Step 5. Stop. 
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Cache Memory 


It is instructive to compare the memory facilities within a computer in relation 
to their functionality. Registers are used to hold the data immediately applicable 
to the operation at hand; main memory is used to hold data that will be needed 
in the near future; and mass storage is used to hold data that will likely not be 
needed in the immediate future. Many machines are designed with an addi- 
tional memory level, called cache memory. Cache memory is a portion (per- 
haps several hundred KB) of high-speed memory located within the CPU itself. 
In this special memory area, the machine attempts to keep a copy of that por- 
tion of main memory that is of current interest. In this setting, data transfers 
that normally would be made between registers and main memory are made 
between registers and cache memory. Any changes made to cache memory are 
then transferred collectively to main memory at a more opportune time. The 
result is a CPU that can execute its machine cycle more rapidly because it is not 
delayed by main memory communication. 


A breakthrough (credited, apparently incorrectly, to John von Neumann) came 
with the realization that a program, just like data, can be encoded and stored in main 
memory. If the control unit is designed to extract the program from memory, decode 
the instructions, and execute them, the program that the machine follows can be 
changed merely by changing the contents of the computer's memory instead of 
rewiring the control unit. 

The idea of storing a computer's program in its main memory is called the stored- 
program concept and has become the standard approach used today- so standard, 
in fact, that it seems obvious. What made it difficult originally was that everyone 
thought of programs and data as different entities: Data were Stored in memory; pro- 
grams were part of the control unit. The result was a prime example of not seeing the 
forest for the trees. It is easy to be caught in such ruts, and the development of com- 
puter science might still be in many ruts today without our knowing it. Indeed, part 
of the excitement of the science is that new insights are constantly opening doors to 
new theories and applications. 


Questions 
& Exercises 


1 . What sequence of events do you think would be required to move the con- 
tents of one memory cell in a computer to another memory cell? 


2 What information must the CPU supply to the main memory circuitry to 
write a value into a memory cell? 


3» Mass storage, main memory, and general-purpose registers are all storage 
systems. What is the difference in their use? 


2.2 Machine Language* 
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2.2 Machine Language 

To apply the stored-program concept, CPUs are designed to recognize instructions 
encoded as bit patterns. This collection of instructions along with the encoding sys- 
tem is called the machine language. An instruction expressed in this language is 
called a machine-level instruction or, more commonly, a machine instruction. 


The Instruction Repertoire 

The list of machine instructions that a typical CPU must be able to decode and execute 
is quite short. Indeed, once a machine can perform certain elementary but well-chosen 
tasks, adding more features does not increase the machine's theoretical capabilities. In 
other words, beyond a certain point, additional features may increase such things as con- 
venience but add nothing to the machine's fundamental capabilities. 

The degree to which machine designs should take advantage of this fact has lead 
to two philosophies of CPU architecture. One is that a CPU should be designed to exe- 
cute a minimal set of machine instructions. This approach leads to what is called a 
reduced instruction set computer (RISC). The argument in favor of RISC archi- 
tecture is that such a machine is efficient and fast. On the other hand, others argue 
in favor of CPUs with the ability to execute a large number of complex instructions, 
even though many of them are technically redundant. The result of this approach is 
known as a complex instruction set computer (CISC). The argument in favor of 
CISC architecture is that the more complex CPU is easier to program because a sin- 
gle instruction can be used to accomplish a task that would require a multi-instruc- 
tion sequence in a RISC design. 

Both CISC and RISC processors are commercially available. The Pentium series 
of processors, developed by Intel, are examples of CISC architecture; the PowerPC 
series of processors (including those that Apple calls G4 and G5), developed by Apple, 
IBM, and Motorola are examples of RISC architecture. (Apple is now building com- 
puters based on Intel products. The shift, however, was for commercial reasons rather 
than distinctions between RISC and CISC philosophies,) 

Regardless of the choice between RISC and CISC, a machine's instructions can be 
categorized into three groupings: (1) the data transfer group, (2) the arithmetic/logic 
group, and (3) the control group. 

Data Transfer The data transfer group consists of instructions that request the move- 
ment of data from one location to another. Steps 1, 2, and 4 in Figure 2.2 fall into this 
category. We should note that using terms such as transfer or move to identify this group 
of instructions is actually a misnomer. It is rare that the data being transferred is erased 
from its original location. The process involved in a transfer instruction is more like 
copying the data rather than moving it. Thus terms such as copy ox done better describe 
the actions of this group of instructions. 

While on the subject of terminology, we should mention that special terms are used 
when referring to the transfer of data between the CPU and main memory. A request 
to fill a general-purpose register with the contents of a memory cell is commonly 
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referred to as a LOAD instruction; conversely, a request to transfer the contents of a reg- 
ister to a memory cell is called a STORE instruction. In Figure 2.2, Steps 1 and 2 are 
LOAD instructions, and Step 4 is a STORE instruction. 

An important group of instructions within the data transfer category consists of 
the commands for communicating with devices outside the CPU-main memory con- 
text (printers, keyboards, monitors, disk drives, etc.). Since these instructions handle 
the input/output (I/O) activities ofthe machine, they are called I/O instructions and 
are sometimes considered as a category in their own right. On the other hand, Sec- 
tion 2.5 describes how these I/O activities can be handled by the same instructions 
that request data transfers between the CPU and main memory. Thus, we shall con- 
sider the I/O instructions to be a part ofthe data transfer group. 

Arithmetic/Logic The arithmetic/logic group consists ofthe instructions that tell 
the control unit to request an activity within the arithmetic/logic unit. Step 3 in Figure 
2.2 falls into this group. As its name suggests, the arithmetic/logic unit is capable of 
performing operations other than the basic arithmetic operations. Some of these addi- 
tional operations are the Boolean operations AND, OR, and XOR, Introduced in 
Chapter 1 , which we will discuss in more detail later in this chapter. 

Another collection of operations available within most arithmetic/logic units 
allows the contents of registers to be moved to the right or the left within the regis- 
ter. These operations are known as either SHIFT or ROTATE operations, depending 
on whether the bits that "fall off the end" ofthe register are merely discarded (SHIFT) 
or are used to fill the holes left at the other end (ROTATE). 

Control The control group consists of those instructions that direct the execution of 
the program rather than the manipulation of data. Step 5 in Figure 2.2 falls into this 
category, although it is an extremely elementary example. This group contains many 
of the more interesting instructions in a machine's repertoire, such as the family of 
JUMP (or BRANCH) instructions used to direct the control unit to execute an instruc- 
tion other than the next one in the list. These JUMP instructions appear in two vari- 
eties; unconditional jumps and conditional jumps . An example ofthe former would 
be the instruction "Skip to Step 5"; an example of the latter would be, "If the value 
obtained is 0, then skip to Step 5." The distinction is that a conditional jump results in 
a "change of venue" only if a certain condition is satisfied. As an example, the sequence 
of instructions in Figure 2.3 represents an algorithm for dividing two values where 
Step 3 is a conditional jump that protects against the possibility of division by zero. 

An Illustrative Machine Language 

Let US now consider how the instructions of a typical computer are encoded. The 
machine that we will use for our discussion is described in Appendix C and summa- 
rized in Figure 2.4. It has 16 general-purpose registers and 256 main memory cells, 
each with a capacity of eight bits. For referencing purposes, we label the registers with 
the values 0 through 15 and address the memory cells with the values 0 through 255. 
For convenience we think of these labels and addresses as values represented in base 
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Figure 2.3 Dividing values stored in memory 


Step 1. LOAD a register with a value 
from memory. 

Step 2. LOAD another register with 
another value from memory. 

Step 3. If this second value is zero, 
JUMP to Step 6. 

Step 4. Divide the contents of the 
first register by the second 
register and leave the result 
in a third register. 

Step 5. STORE the contents of the 
third register in memory. 

Step 6. STOP. 


two and compress the resulting bit patterns using hexadecimal notation. Thus, the reg- 
isters are labeled 0 through F, and the memory cells are addressed 00 through FF. 

The encoded version of a machine instruction consists of two parts: the op-code 
(short for operation code) field and the operand field. The bit pattern appearing in the 
op-code field indicates which of the elementary operations, such as STORE, SHIFT, XOR, 
and JUMP, is requested by the instruction. The bit patterns found in the operand field 
provide more detailed information about the operation specified by the op-code. For 
example, in the case of a STORE operation, the information in the operand field indicates 
which register contains the data to be stored and which memory cell is to receive the data. 


Figure 2.4 The architecture of the machine described in Appendix C 
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Variable-Length Instructions 

To simplify explanations in the text, the machine language described in Appendix 
C uses a fixed size (two bytes) for all instructions. Thus, to fetch an instruction, 
the CPU always retrieves the contents of two consecutive memory cells and 
increments its program counter by two. This consistency streamlines the task of 
fetching instructions and is characteristic of RISC machines. CISC machines, 
however, have machine languages whose instructions vary in length. The Pen- 
tium series, for example, has instructions that range from single-byte instructions 
to multiple-byte instructions whose length depends on the exact use of the 
instruction. CPUs with such machine languages determine the length of the 
incoming instruction by the instruction's op-code. That is, the CPU first fetches 
the op-code of the instruction and then, based on the bit pattern received, knows 
how many more bytes to fetch from memory to obtain the rest of the instruction. 


The entire machine language of our illustrative machine (Appendix C) consists 
of only 12 basic instructions. Each ofthese instructions is encoded using a total of 16 
bits, represented by four hexadecimal digits (Figure 2.5). The op-code for each instruc- 
tion consists of the first four bits or, equivalently, the first hexadecimal digit. Note 
(Appendix C) that these op-codes are represented by the hexadecimal digits 1 through 
C. In particular, the table in Appendix C shows us that an instruction beginning with 
the hexadecimal digit 3 refers to a STORE instruction, and an instruction beginning 
with hexadecimal A refers to a ROTATE instruction. 

The operand field of each instruction in our illustrative machine consists of three 
hexadecimal digits (12 bits), and in each case (except for the HALT instruction, which 
needs no further refinement) clarifies the general instruction given by the op-code. 
For example (Figure 2.6), if the first hexadecimal digit of an instruction were 3 (the 
op-code for storing the contents of a register), the next hexadecimal digit of the instruc- 
tion would indicate which register is to be stored, and the last two hexadecimal dig- 
its would indicate which memory cell is to receive the data. Thus the instruction 35A7 
(hexadecimal) translates to the statement "STORE the bit pattern found in register 5 
in the memory cell whose address is A7." (Note how the use of hexadecimal notation 
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0011 0101 1010 0111 Actual bit pattern (16 bits) 

I I I I 


3 


5 


A 


7 


Hexadecimal form [4 digits) 
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Figure 2.6 Decoding the instruction 35A7 


I nstruction- A 3 

7 

Op-code 3 meapgS 
to store the contents 
of a register in a 
memory cell. 


simplifies our discussion. In reality, the instruction 35A7 is the bit pattern 
0011010110100111 .) 

(The instruction 35A7 also provides an explicit example of why main memory 
capacities are measured in powers of two. Because eight bits in the instruction are 
reserved for specifying the memory cell utilized by this instruction, it is possible to 
reference exactly 2 B different memory cells. It behooves us therefore to build mam 
memory with this many cells-addressed from 0 to 255. If main memory had more 
cells, we would not be able to write instructions that distinguished between them; if 
main memory had fewer cells, wc would be able to write instructions that referenced 
non-existing cells .) 

As another example of how the operand field is used to clarify the general instruc- 
tion given by op-code, consider an instruction with the op-code 7 (hexadecimal), which 
requests that the contents of two registers be ORed. (We will see what it means to OR 
two registers in Section 2,4. For now we are interested merely in how instructions are 
encoded.) In this case, the next hexadecimal digit indicates the register in which the 
result should be placed, while the last two hexadecimal digits indicate which two reg- 
isters are to be ORed. Thus the instruction 70C5 translates to the statement "OR the con- 
tents of register C with the contents of register 5 and leave the result in register 0." 

A subtle distinction exists between our machine's two LOAD instructions. Here 
we see that the op-code 1 (hexadecimal) identifies an instruction that loads a register 
with the contents of a memory cell, whereas the op-code 2 (hexadecimal) identifies 
an instruction that loads a register with a particular value. The difference is that the 
operand field in an instruction of the first type contains an address, whereas in the 
second type the operand field contains the actual bit pattern to be loaded. 

Note that the machine has two ADD instructions: one for adding two's comple- 
ment representations and one for adding floating-point representations. This distinc- 
tion is a consequence of the fact that adding bit patterns that represent values encoded 
in two's complement notation requires different activities within the arithmetic/logic 
unit from adding values encoded in floating-point notation. 


This part of the operand identifi 
the address of the memory ceil 
that is to receive data. 


This part of the operand identifie 
the register whose contents are 
to be stored . 
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Figure 2.7 An encoded version of the instructions in Figure 2.2 


Encoded 

instructions Translation 


156C Load register 5 with the bit pattern 

found in the memory cell at 
address 6C. 


1 66 D Load register 6 with the bit pattern 

found in the memory cell at 
address 6D. 


5056 Add the contents of register 5 and 

6 as though they were two's 
complement representation and 
leave the result in register 0. 


306 E Storo the contents of register 0 

in the memory cell at address 6E. 


COOO Halt. 


We close this section with Figure 2.7, which contains an encoded version of the 
instructions in Figure 2.2. We have assumed that the values to be added are stored in 
two's complement notation at memory addresses 6C and 6D and the sum is to be 
placed in the memory cell at address 6E. 


Questions 
& Exercises 


1 . Why might the term move be considered an incorrect name for the operation 
of moving data from one location in a machine to another? 

2. In the text, JUMP instructions were expressed by destination 

explicitly by stating the name (or step number) of the destination within the 
JUMP instruction (for example, "Jump to Step 6"). A drawback of this tech- 
nique is that if an instruction name (number) is later changed, we must be 
sure to find all jumps to that instruction and change that name also. Describe 
another way of expressing a JUMP instruction so that the name of the desti- 
nation is not explicitly stated. 

3 . Is the instruction "If 0 equals 0, thenjump to Step 7" a conditional or uncon- 
ditional jump? Explain your answer. 

Write the example program in Figure 2.7 in actual bit patterns. 
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5. The following are instiittcttmoms written in the machine language described in 
Appendix C. Rewrite them in English. 

a. 368A b. BADE c. 803C d. 40F4 

6. What is the difference between the instructions 15 AB and 25 AB in the 
machine language of Appendix C? 

7- Here are some instructions in English. Translate each of them into the 
machine language of Appendix C. 

a. LOAD register number 3 with the hexadecimal value 56. 

b. ROTATE register number55tth¥Ucfete light, 

c. AND the contents of regjtiifCJf A HvWh cdtllteiftfcs <Glf 5 &ftd lo&VQ th© 

result in register 0. 


2.3 Program Execution 

A computer follows a program stored in its memory by copying the instructions from 
memory into the control unit as needed. Once in the control unit, each instruction is 
decoded and obeyed. The order in which the instructions are fetched from memory 
corresponds to the order in which the instructions are stored in memory unless oth- 
erwise altered by a JUMP instruction. 


Who Invented What? 

Awarding a single individual credit for an invention is always a dubious under- 
taking. Thomas Edison is credited with inventing the incandescent lamp, but 
other researchers were developing similar lamps, and in a sense he was lucky to 
he the one to obtain the patent. The Wright brothers are credited with inventing 
the airplane, but they benefited from the research of others, and to some degree, 
they were pre-empted by Leonardo da Vinci, who toyed with the idea of flying 
machines in the fifteenth century. Even Leonardo's designs were apparently 
based on earlier ideas. Of course, in these cases the designated inventor still has 
legitimate claims to the credit bestowed. In other cases, history seems to have 
awarded credit inappropriately-an example is the stored-program concept. 
Without a doubt, John von Neumann was a brilliant scientist who deserves 
credit tor numerous contributions. But the contribution for which popular his- 
tory has chosen to credit him, the stored-program concept, was apparently devel- 
oped by researchers led by J. P. Eckert at the Moore School of Electrical 
Engineering at the University of Pennsylvania. John von Neumann was merely 
the first to publish work reporting the idea and thus computing lore has selected 
him as the inventor. 
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To understand how the overall execution process takes place, it is necessary to 
take a closer look at the control unit inside the CPU. Within this unit are two special- 
purpose registers: the instruction register and the program counter (see again Fig- 
ure 2.4). The instruction register is used to hold the instruction being executed. The 
program counter contains the address of the next instruction to be executed, thereby 
serving as the machine's way of keeping track of where it is in the program. 

The control unit performs its job by continually repeating an algorithm that guides 
it through a three-step process known as the machine cycle. The steps in the machine 
cycle are fetch, decode, and execute (Figure 2.8). During the fetch step, the control 
unit requests that main memory provide it with the instruction that is stored at the 
address indicated by the program counter. Since each instruction in our machine is 
two bytes long, this fetch process involves retrieving the contents of two memory 
cells from main memory. The control unit places the instruction received from mem- 
ory in its instruction register and then increments the program counter by two so 
that the counter contains the address of the next instruction stored in memory. Thus 
the program counter will be ready for the next fetch. 

With the instruction now in the instruction register, the control unit decodes the 
instruction, which involves breaking the operand field into its proper components 
based on the instruction's op-code. 

The control unit then executes the instruction by activating the appropriate cir- 
cuitry to perform the requested task. For example, if the instruction is a load from mem- 
ory, the control unit sends the appropriate signals to main memory, waits for main 
memory to send the data, and then places the data in the requested register; if the 


Figure 2.8 The machine cycle 



required by the 
instruction in the 
instruction register. 
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instruction is for an arithmetic operation, the control unit activates the appropriate cir- 
cuitry in the arithmetic/logic unit with the correct registers as inputs and waits for the 
arithmetic/logic unit to compute the answer and place it in the appropriate register. 

Once the instruction in the instruction register has been executed, the control unit 
again begins the machine cycle with the fetch step. Observe that since the program 
counter was incremented at the end of the previous fetch, it again provides the con- 
trol unit with the correct address. 

A somewhat special case is the execution of a JUMP instruction. Consider, for 
example, the instruction B258 (Figure 2.9), which means "JUMP to the instruction at 
address 58 (hexadecimal) if the contents of register 2 is the same as that of register 
0." In this case, the execute step of the machine cycle begins with the comparison of 
registers 2 and 0. If they contain different bit patterns, the execute step terminates and 
the next machine cycle begins. If, however, the contents of these registers are equal, 
the machine places the value 58 (hexadecimal) in its program counter during the exe- 
cute step. In this case, then, the next fetch step finds 58 in the program counter, so 
the instruction at that address will be the next instruction to be fetched and executed. 

Note that if the instruction had been B058, then the decision of whether the pro- 
gram counter should be changed would depend on whether the contents of register 
0 was equal to that of register 0. But these are the same registers and thus must have 
equal content. In turn, any instruction of the form BOXY will cause a jump to be exe- 
cuted to the memory location XY regardless of the contents of register 0. 


An Example of Program Execution 


Let us follow the machine cycle applied to the program presented in Figure 2.7 which 
retrieves two values from main memory, computes their sum, and stores that total in 
a main memory cell. We first need to put the program somewhere in memory. For our 


Figure 2.9 Decoding the instruction B258 


Instruction-* B 2 5 8 


Op-code B means to 
change the value of 
the program counter 
if the contents of the 
indicated register is 
the same as that in 
register 0. 




This part of the operand is the 
address to be placed in the 
program counter. 


This part of the operand identifies 
the register to be compared to 
register 0. 
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example, suppose the program is stored in consecutive addresses, starting at address 
AO (hexadecimal). With the program stored in this manner, we can cause the machine 
to execute it by placing the address (AO) of the first instruction in the program counter 
and starting the machine (Figure 2.10). 

The control unit begins the fetch step of the machine cycle by extracting the 
instruction stored in main memory at location AO and placing this instruction (156C) 
in its instruction register (Figure 2.11a). Notice that, in our machine, instructions are 
16 bits (two bytes) long. Thus the entire instruction to be fetched occupies the mem- 
ory cells at both address AO and Al. The control unit is designed to take this into 
account so it retrieves the contents of both cells and places the bit patterns received 
in the instruction register, which is 16 bits long. The control unit then adds two to the 
program counter so that this register contains the address of the next instruction (Fig- 
ure 2.11b). At the end of the fetch step of the first machine cycle, the program counter 
and instruction register contain the following data: 

Program Counter: A2 
Instruction Register: 156C 

Next, the control unit analyzes the instruction in its instruction register and con- 
cludes that it is to load register 5 with the contents of the memory cell at address 6C. 
This load activity is performed during the execution step of the machine cycle, and 
the control unit then begins the next cycle. 


Figure 2.1CJ The program from Figure 2.7 stored in main memory ready for execution 


Program counter contains 
address of first instructions. 


CPU 
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Program counter 
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instruction register 
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Figure 2.1 1 Performing the (etch step of the machine cycle 


CPU Main memory 


Program counter 



a. At the beginning of the fetch step the instruction starting at address AO is 
retrieved from memory and placed in the instruction register. 


CPU 


Main memory 


Program counter 



Instruction register 
I 1 5 6 C 

i 



Address 

Cells 

Bus 

AO 

1 15 i 

Al 

□Ej 


A2 

rTfii 


A3 
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b. Then the program counter is incremented so that it points to the next instruction. 


This cycle begins by fetching the instruction 166D from the two memory cells 
starting at address A2. The control unit places this instruction in the instruction reg- 
ister and increments the program counter to A4. The values in the program counter 
and instruction register therefore become the following: 

Program Counter. A4 
Instruction Register: 166D 

Now the control unit decodes the instruction 166D and determines that it is to load 
register 6 with the contents of memory address 6D. It then executes the instruction. 
It is at this time that register 6 is actually loaded. 




no 
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Comparing Computer Power 

When shopping for a personal computer, you will find that clock speeds are 
often used to compare machines. A computer's clock is a circuit, called an oscil- 
lator, which generates pulses that are used to coordinate the machine's activi- 
ties -the faster this oscillating circuit generates pulses, the faster the machine 
performs its machine cycle. Clock speeds are measured in hertz (abbreviated as 
Hz) with one Hz equal to one cycle (or pulse) per second. Typical clock speeds 
in desktop computers are in the range of a few hundred MHz (older models) to 
several GHz. (MHz is short for megahertz, which is a million Hz. GHz is short 
for gigahertz, which is 1000 MHz.) 

Unfortunately, different CPU designs might perform different amounts of 
work in one clock cycle, and thus clock speed alone fails to be relevant in com- 
paring machines with different CPUs. If you are comparing a machine based on a 
PowerPC to one based on a Pentium, it would be more meaningful to compare 
performance by means of benchmarking, which is the process of comparing the 
performance of different machines when executing the same program, known as 
a benchmark. By selecting benchmarks representing different types of applica- 
tions, you get meaningful comparisons for various market segments. The best 
machine for one application might not be the best for another. 


Since the program counter now contains A4, the control unit extracts the next 
instruction starting at this address. The result is that 5056 is placed in the instruction 
register, and the program counter is incremented to A6. The control unit now decodes 
the contents of its instruction register and executes it by activating the two's com- 
plement addition circuitry with inputs being registers 5 and 6. 

During this execution step, the arithmetic/logic unit performs the requested addi- 
tion, leaves the result in register 0 (as requested by the control unit), and reports to 
the control unit that it has finished. The control unit then begins another machine 
cycle. Once again, with the aid of the program counter, it fetches the next instruction 
(306E) from the two memory cells starting at memory location A6 and increments the 
program counter to A8. This instruction is then decoded and executed. At this point, 
the sum is placed in memory location 6E. 

The next instruction is fetched starting from memory location AS, and the pro- 
gram counter is incremented to AA. The contents of the instruction register (COOO) 
are now decoded as the halt instruction. Consequently, the machine stops during the 
execute step of the machine cycle, and the program is completed. 

In summary, wc see that the execution of a program stored in memory involves the 
same process you and 1 might use if we needed to follow a detailed list of instructions. 
Whereas we might keep our place by marking the instructions as we perform them, the 
computer keeps Its place by using the program counter. After determining which 
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instruction to execute next, we would read the instruction and extract its meaning. 
Then, we would perform the task requested and return to the list for the next instruc- 
tion in the same manner that the machine executes the instruction in its instruction 
register and then continues with another fetch. 

Programs Versus Data 

Many programs can be stored simultaneously in a computer's main memory, as long 
as they occupy different locations. Which program will be run when the machine is 
started can then be determined merely by setting the program counter appropriately. 

One must keep in mind, however, that because data are also contained in main 
memory and encoded in terms of Os and Is, the machine alone has no way of know- 
ing what is data and what is program. If the program counter were assigned the address 
of data instead of the address of the desired program, the computer, not knowing any 
better, would extract the data bit patterns as though they were instructions and exe- 
cute them. The final result would depend on the data involved. 

We should not conclude that providing programs and data with a common 
appearance in a machine's memory Is bad. In fact, it has proved a useful attribute 
because it allows one program to manipulate other programs (or even itself) the 
same as it would data. Imagine, for example, a program that modifies itself in 
response to its interaction with its environment and thus exhibits the ability to learn, 
or perhaps a program that writes and executes other programs in order to solve prob- 
lems presented to it. 


1 . Suppose the memory cells from addresses 00 to 05 in the machine described 
in Appendix C contain the (hexadecimal) bit patterns given in the following 
table: 


Address 

Contents 

00 

14 

01 

02 

02 

34 

03 

17 

04 

CO 

05 

00 


If we start the machine with its program counter containing 00, what bit pat- 
tern is in the memory cell whose address is hexadecimal 17 when the 
machine halts? 

2 Suppose the memory cells at addresses B0 to B 8 in the machine described in 
Appendix C contain the (hexadecimal) bit patterns given in the following 
table: 


Questions* 
& Exercise J; 


Address 

Contents* 

iso 

13 

B1 

B8 

B2 

A3 

B3 

02 

B4 

33 

B5 

B8 

B6 

CO 

B7 

00 

B8 

OF 

a. If the program counter starts at BO, what bit pattern is in register number 

3 after the 

first instruction has been executed? 

b. What bit pattern is in m&flfiWMfy C@ll wift&li dtofe lfo&lt instruction is 

executed? 


Suppose the memory cells at addresses A4 to B1 in the machine described in 
Appendix C contain the (hexadecimal) bit patterns given in the following 

table: 


Address 

Contents. 

A4 

20 

A5 

00 

A6 

21 

A7 

03 

A8 

22 

A9 

01 

AA 

B1 

AB 

BO 

AC 

50 

AD 

02 

AE 

BO 

AF 

AA 

BO 

CO 

B1 

00 


When answering the following questions, assume that the machine is started 

with its program counter containing A4. 

a. What is in register 0 the flfSt dh© dftSttlfUCtioiS at address AA is 
executed? 

b. What is in register 0 the second time the instruction at address AA is 
executed'? 

c. How many times is the instruction at address AA executed before the 
machine halts? 
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4. Suppose the memory cells at addresses FO to F9 in the machine described in 
Appendix C contain the (hexadecimal) bit patterns described in the following 
table: 


Address 

Contents 

FO 

20 

FI 

CO 

F2 

30 

F3 

F8 

F4 

20 

F5 

00 

F6 

30 

F7 

F9 

F8 

FF 

F9 

FF 


If we start the machine with its program counter containing FO, what does the 
machine do when it reaches the instruction at address F8? 


2.4 Arithmetic/Logic Instructions 

As indicated earlier, the arithmetic/logic group of instructions consists of instructions 
requesting arithmetic, logic, and shift operations. In this section, we look at these 
operations more closely. 

Logic Operations 

We introduced the logic operations AND , OR, and XOR (exclusive or) in Chapter 1 as 
operations that combine two input bits to produce a single output bit. These opera- 
tions can be extended to operations that combine two strings of bits to produce a sin- 
gle output string by applying the basic operation to individual columns. For example, 
the result of ANDing the patterns 10011010 and 11001001 results in 

10011010 
AMD 11001001 

10001000 

where we have merely written the result of ANDing the two bits in each column at the 
bottom of the column. Likewise, ORing and XORing these patterns would produce 

10011010 10011010 

OR 11001001 XOR 11001001 

11011011 01010011 

One of the major uses of the AND operation is for placing 0s in one part of a bit 
pattern while not disturbing the other part. Consider, for example, what happens if the 
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byte 00001113 is the first operand of an AND operation. Without knowing the contents 
of the second operand, we still can conclude that the four most significant bits of the 
result will be Os. Moreover, the four least significant bits of the result will be a copy 
of that part of the second operand, as shown in the following example: 

00001111 
AMD 10101010 

00001010 

This use of the AND operation is an example of the process called masking. Here 
one operand, called a mask, determines which part of the other operand will affect 
the result. In the case of the AND operation, masking produces a result that is a par- 
tial replica of one of the operands, with Os occupying the nonduplicated positions. 

Such an operation is useful when manipulating a bit map, a string of bits in 
which each bit represents the presence or absence of a particular object. We have 
already encountered bit maps in the context of representing images, where each bit 
is associated with a pixel. As another example, a string of 52 bits, in which each bit is 
associated with a particular playing card, can be used to represent a poker hand by 
assigning Is to those 5 bits associated with the cards in the hand and Os to all the oth- 
ers. Likewise, abit map of 52 bits, of which 13 arc Is, can be used to represent a hand 
of bridge, or a bit map of 32 bits can be used to represent which of 32 ice cream fla- 
vors are available. 

Suppose, then, that the eight-bits in a memory cell are being used as a bit map, 
and we want to find out whether the object associated with the third bit from the 
high-order end is present. We merely need to AND the entire byte with the mask 
00100000, which produces abyte of all 0s if and only if the third bit from the high-order 
end of the bit map is itself 0. A program can then act accordingly by following the AND 
operation with a conditional branch instruction. Moreover, if the third bit from the 
high-order end of the bit map is a 1, and we want to change it to a 0 without disturbing 
the other bits, we can AND the bit map with the mask 11011111 and then store the 
result in place of the original bit map. 

Where the AND operation can be used to duplicate a part of a bit string while 
placing 0s in the nonduplicated part, the OR operation can be used to duplicate a part 
of a string while putting Is in the nonduplicated part. For this we again use a mask, 
but this time we indicate the bit positions to be duplicated with 0s and use 1 s to indi- 
cate the nonduplicated positions. For example, ORing any byte with 11110000 pro- 
duces a result with Is in its most significant four bits while its remaining bits area 
copy of the least significant four bits of the other operand, as demonstrated by the 
following example: 

11110000 
OR 10101010 

11111010 

Consequently, whereas the mask 11011111 can be used with the AND operation to 
force a 0 in the third bit from the high-order end of a byte, the mask 00100000 can be 
used with the OR operation to force a 1 in that position. 
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A major use of the XOR operation is in forming the complement of a bit string. 
XORing any byte with a mask of all 1 s produces the complement of the byte. For 
example, note the relationship between the second operand and the result in the fol- 
lowing example: 

11111111 
XOR 10101010 

01010101 

In the machine language described in Appendix C, op-codes 7, 8, and 9 are used 
for the logic operations OR, AND, and XOR, respectively. Each requests that the cor- 
responding logic operation be performed between the contents of two designated reg- 
isters and that the result be placed in another designated register. For example, the 
instruction 7ABC requests that the result of ORing the contents of registers B and C 
be placed in register A. 

Rotation and Shift Operations 

The operations in the class of rotation and shift operations provide a means for mov- 
ing bits within a register and are often used in solving alignment problems. These 
operations are classified by the direction of motion (right or left) and whether the 
process is circular. Within these classification guidelines are numerous variations with 
mixed terminology. Let us take a quick look at the ideas involved. 

Consider a register containing a byte of bits. If we shift its contents one bit to the 
right, we imagine the rightmost bit falling off the edge and a hole appearing at the left- 
most end. What happens with this extra bit and the hole is the distinguishing feature 
among the various shift operations. One technique is to place the bit that fell off the 
right end in the hole at the left end. The result is a circular shift, also called a rota- 
tion. Thus, if we perform a right circular shift on a byte-size bit pattern eight times, 
we obtain the same bit pattern we started with. 

Another technique is to discard the bit that falls off the edge and always fill the 
hole with a 0. The term logical shift is often used to refer to these operations. Such 
shifts to the left can be used for multiplying two's complement representations by 
two. After all, shifting binary digits to the left corresponds to multiplication by two, 
just as a similar shift of decimal digits corresponds to multiplication by ten. More- 
over, division by two can be accomplished by shifting the binary string to the right. 
In either shift, care must be taken to preserve the sign bit when using certain nota- 
tional systems. Thus, we often find right shifts that always fill the hole (which occurs 
at the sign bit position) with its original value. Shifts that leave the sign bit unchanged 
are sometimes called arithmetic shifts. 

Among the variety of shift and rotate instructions possible, the machine language 
described in Appendix C contains only a right circular shift, designated by op-code A. 
In this case the first hexadecimal digit in the operand specifies the register to be 
rotated, and the rest of the operand specifies the number of bits to be rotated. Thus 
the instruction A501 means "Rotate the contents of register 5 to the right by 1 bit." In 
particular, if register 5 originally contained the bit pattern 65 (hexadecimal), then it 
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Figure 2.12 Rotating the bit pattern 65 (hexadecimal) one bit to the right 
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The original bit pattern 


The bits move one position 
to the right. The rightmost 
bit "falls off" the end and 
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1 0 0 


1 0 


The final bit pattern 


would contain B2 after this instruction is executed (Figure 2.12). (You may wish to 
experiment with how other shift and rotate instructions can be produced with com- 
binations of the instructions provided in the machine language of Appendix C. For 
example, since a register is eight bits long, a right circular shift of three bits produces 
the same result as a left circular shift of five bits.) 

Arithmetic Operations 

Although we have already mentioned the arithmetic operations of add, subtract, mul- 
tiply, and divide, a few loose ends should still be connected. First, we have already 
seen that subtraction can be simulated by means of addition and negation. Moreover, 
multiplication is merely repeated addition and division is repeated subtraction. (Six 
divided by two is three because three two's can be subtracted from six.) For this rea- 
son, some small CPUs are designed with only the add or perhaps only the add and sub- 
tract instructions. 

We should also mention that numerous variations exist for each arithmetic opera- 
tion. We have already alluded to this in relation to the add operations available on our 
machine in Appendix C. In the case of addition, for example, if the values to be added 
are stored in two's complement notation, the addition process must be performed as a 
straightforward column by column addition. However, if the operands are stored as 
floating-point values, the addition process must extract the mantissa of each, shift them 
right or left according to the exponent fields, check the sign bits, perform the addition, 
and translate the result into floating-point notation. Thus, although both operations are 
considered addition, the action of the machine is not the same. 
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1 . Perform the indicated 

operations. 


Questions 

a. oiooifeii 

b. 

looooon 

03. IMMMi 

&&05 oeBrtsiees 

AND 10101011 


AND 11101100 

AND 00101101 


d. 01001011 

e. 

10000011 

f . 11111111 


OR 10101011 


OR 11101100 

OR 00101101 


g. 01001011 

h. 

10000011 

i. ilium 


XOR 10101011 


XOR 11101100 

XOR 00101101 



2. Suppose you want to isolate the middle four bits of a byte by placing Os in the 
other four bits without disturbing the middle four bits. What mask must you 
use together with what operation? 

3. Suppose you want to complement the four middle bits of a byte while leaving 
the other four bits undisturbed. What mask must you use together with what 
operation? 

4. a. Suppose you XOR the first tw® iMtts <^tf Iibtescaix4i ttihiteiA continue 

down the string by successively XORing each result with the next bit in 
the string. How is your result related to the number of Is appearing in the 
string? 

b. How does this problem -rdlalBe ti®) t^eUeaiifiiiiimiifitig wlfoatt tihe expropriate parity 
bit should be when encoding a message? 

5. It is often convenient to use a logical operation in place of a numeric one. For 
example, the logical operation AND combines two bits in the same manner as 
multiplication. Which logical operation is almost the same as adding two bits, 
and what goes wrong in this case? 

6. What logical operation witth what ma&k eauti y 

codes of lowercase letters to uppercase? What about uppercase to lowercase? 

7. What is the result of performing a three-bit right circular shift on the following 
bit strings: 

a. 01101010 b. 00001111 c. 01111111 

8. What is the result of performing a one-bit left circular shift on the following 
bytes represented in hexadecimal notation? Give your answer in hexadecimal 
form. 

a. AB b. 5C c. B7 d. 35 

9. A right circular shift of three bits on a string of eight bits is equivalent to a left 
circular shift of how many bits? 

1 0. What bit pattern represents the sum of 01101010 and 11001100 if the patterns 
represent values stored in two's complement notation? What if the patterns 
represent values stored in the floating-point format discussed in Chapter 1 ? 


118 


Data Manipulation! 


11, Using the machine language of Appendix C, write a program that places a 1 
in the most significant bit of the memory cell whose address is A7 without 
modifying the remaining bits in the cell. 

12. Using the machine language of Appendix C, write a program that copies the 
middle four bits from memory cell EO into the least significant four bits of 
memory cell El, while placing Os in the most significant four bits of the cell 
at location El. 


2.5 Communicating with Other Devices 

Main memory and the CPU form the core of a computer. In this section, we investi- 
gate how this core, which we will refer to as the computer, communicates with periph- 
eral devices such as mass storage systems, printers, keyboards, mice, monitors, digital 
cameras, and even other computers. 


The Role of Controllers 

Communication between a computer and other devices is normally handled through 
an intermediary apparatus known as a controller. In the case of a personal com- 
puter, a controller may consist of circuitry permanently mounted on the computer's 
motherboard or, for flexibility, it may take the form of a circuit board that plugs into 
a slot on the motherboard. In either case, the controller connects via cables to periph- 
eral devices within the computer case or perhaps to a connector, called a port, on the 
back of the computer where external devices can be attached. These controllers are 
sometimes small computers themselves, each with its own memory circuitry and 
simple CPU that performs a program directing the activities of the controller. 

A controller translates messages and data back and forth between forms com- 
patible with the internal characteristics of the computer and those of the peripheral 
device to which it is attached. Originally, each controller was designed for a particu- 
lar type of device; thus, purchasing a new peripheral device often required the pur- 
chase of a new controller as well. 

Recently, steps have been taken within the personal computer arena to develop 
standards, such as the universal serial bus (USB) and FireWire, by which a single 
controller is able to handle a variety of devices. For example, a single USB controller 
can be used as the interface between a computer and any collection of USB-compat- 
ible devices. The list of devices on the market today that can communicate with a USB 
controller includes mice, printers, scanners, mass storage devices, and digital cameras. 

Each controller communicates with the computer itself by means of connections 
to the same bus that connects the computer's CPU and main memory (Figure 2.13). 
From this position it is able to monitor the signals being sent between the CPU and 
main memory as well as to inject its own signals onto the bus. 
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Figure 2.13 Controllers attached to a machine's bus 
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With this arrangement, the CPU is able to communicate with the controllers 
attached to the bus in the same manner that it communicates with main memory. To 
send a bit pattern to a controller, the bit pattern is first constructed in one of the CPU's 
general-purpose registers. Then an instruction similar to a STORE instruction is exe- 
cuted by the CPU to "store" the bit pattern in the controller. Likewise, to receive a bit 
pattern from a controller, an instruction similar to a LOAD instruction is used. 

In some computer designs the transfer of data to and from controllers is directed 
by the same LOAD and STORE op-codes that are already provided for communication 
with main memory. In these cases, each controller is designed to respond to references 
to a unique set of addresses while main memory is designed to ignore references to 
these locations. Thus when the CPU sends a message on the bus to store a bit pattern 
at a memory location that is assigned to a controller, the bit pattern is actually "stored" 
in the controller rather than main memory. Likewise, if the CPU tries to read data from 
such a memory location, as in a LOAD instruction, it will receive a bit pattern from 
the controller rather than from memory. Such a communication system is called 
memory-mapped I/O because the computer's input/output devices appear to be in 
various memory locations (Ligure 2.14). 


Figure 2.14 A conceptual representation of memory-mapped M) 
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An alternative to memory-mapped I/O is to provide special op-codes in the 
machine language to direct transfers to and from controllers. Instructions with these 
op-codes are called I/O instructions. As an example, if the language described in Appen- 
dix C followed this approach, it might include an instruction such as F5A3 to mean 
"STORE the contents of register 5 in the controller identified by the bit pattern A3." 

Direct Memory Access 

Since a controller is attached to a computer's bus, it can carry on its own communi- 
cation with main memory during those nanoseconds in which the CPU is not using 
the bus. This ability of a controller to access main memory is known as direct mem- 
ory access (DMA), and it is a significant asset to a computer's performance. For 
instance, to retrieve data from a sector of a disk, the CPU can send requests encoded 
as bit patterns to the controller attached to the disk asking the controller to read the 
sector and place the data in a specified area of main memory. The CPU can then con- 
tinue with other tasks while the controller performs the read operation and deposits 
the data in main memory via DMA. Thus two activities will be performed at the same 
time. The CPU will be executing a program and the controller will be overseeing the 
transfer of data between the disk and main memory. In this manner, the computing 
resources of the CPU are not wasted during the relatively slow data transfer. 

The use of DMA also has the detrimental effect of complicating the communica- 
tion taking place over a computer's bus. Bit patterns must move between the CPU and 
main memory, between the CPU and each controller, and between each controller 
and main memory. Coordination of all this activity on the bus is a major design issue. 
Even with excellent designs, the central bus can become an impediment as the CPU 
and the controllers compete for bus access. This impediment is known as the von 
Neumann bottleneck because it is a consequence of the underlying von Neumann 
architecture in which a CPU fetches its instructions from memory over a central bus. 

Hand Shaking 

The transfer of data between two computer components is rarely a one-way affair. 
Even though we may think of a printer as a device that receives data, the truth is that 
a printer also sends data back to the computer. After all, a computer can produce and 
send characters to a printer much faster than the printer can print them. If a computer 
blindly sent data to a printer, the printer would quickly fall behind, resulting in lost 
data. Thus a process such as printing a document involves a constant two-way dia- 
logue, known as handshaking, in which the computer and the peripheral device 
exchange information about the device's status and coordinate their activities. 

Handshaking often involves a status word, which is a bit pattern that is gen- 
erated by the peripheral device and sent to the controller. The status word is a bit 
map in which the bits reflect the conditions of the device. For example, in the case 
of a printer, the value of the least significant bit of the status word may indicate 
whether the printer is out of paper, while the next bit may indicate whether the 
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USB and Firewire 

The universal serial bus (USB) and Fire Wire are standardized serial communica- 
tion systems that simplify the process of adding new peripheral devices to a per- 
sonal computer. USB was developed under the lead of Intel. The development of 
Fire Wire was led by Apple. In both cases the underlying theme is for a single 
controller to provide external ports at which a variety of peripheral devices can 
be attached. In this setting, the controller translates the internal signal character- 
istics of the computer to the appropriate USB or FireWire standard signals, in 
turn, each device connected to the controller converts its internal idiosyncrasies 
to the same USB or FireWire standard, allowing communication with the con- 
troller. The result is that attaching a new device to a PC does not require the 
insertion of a new controller. Instead, one merely plugs any USB compatible 
device into a USB port or a FireWire compatible device into a FireWire port. 

Of the two, FireWire provides a faster transfer rate, but the lower cost of 
USB technology has made it the leader in the lower-cost mass market arena. 
USB compatible devices on the market today include mice, keyboards, printers, 
scanners, digital cameras, and mass storage systems designed for backup appli- 
cations. FireWire applications tend to focus on devices that require higher trans- 
fer rates such as video recorders and online mass storage systems. 


printer is ready for additional data. Still another bit may be used to indicate the pres- 
ence of a paper jam. Depending on the system, the controller may respond to this 
status information itself or make it available to the CPU. In either case, the status 
word provides the mechanism by which communication with a peripheral device can 
be coordinated. 

Popular Communication Media 

Communication between computing devices is handled over two types of paths: par- 
allel and serial. These terms refer to the manner in which signals are transferred with 
respect to each other. In the case of parallel communication, several signals are 
transferred at the same time, each on a separate "line." Such a technique is capable 
of transferring data rapidly but requires a relatively complex communication path. 
Examples include a computer's internal bus where multiple wires are used to allow 
large blocks of data and other signals to be transferred simultaneously. Moreover, 
most PCs are equipped with at least one "parallel port" through which data can be 
transferred to and from the machine eight bits at a time. 

In contrast, serial communication is based on transferring signals one after the 
other over a single line. Thus serial communication requires a simpler data path than 
parallel communication, which is the reason for its popularity. USB and FireWire, 
which offer relatively high speed data transfer over short distances of only a few 
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meters, are examples of serial communication systems. For slightly longer distances 
(within a home or office building), serial communication over Ethernet connections 
(Section 4.1), either by wire or radio broadcast, are popular. 

For communication over greater distances, traditional voice telephone lines 
dominated the personal computer arena for many years. These communication 
paths, consisting of a single wire over which tones are transferred one after the 
other, are inherently serial systems. The transfer of digital data over these lines is 
accomplished by first converting bit patterns into audible tones by means of a 
modem (short for modulator-demodulator), transferring these tones serially over the 
telephone system, and then converting the tones back into bits by another modem 
at the destination. 

For higher quality long-distance communication, telephone companies offer a 
service known as DSL (Digital Subscriber Line), which takes advantage of the 
fact that existing telephone lines are capable of handling a wider frequency range 
than that used by traditional voice communication. More precisely, DSL uses fre- 
quencies above the audible range to transfer digital data while leaving the lower fre- 
quency spectrum for voice communication. Other technologies that compete with 
DSL include cable, as used in cable television systems, and satellite links via radio 
broadcast. 


Communication Rates 

The rate at which bits are transferred from one computing component to another is 
measured in bits per second (bps). Common units include Kbps (kilo-bps, equal 
to 1000 bps). Mbps (mega-bps, equal to 1 million bps), and Gbps (giga-bps, equal to 
1 billion bps). (Note the distinction between bits and bytes-that is, 8 Kbps is equal 
to 1 KB per second. In abbreviations, a lowercase b usually means bit whereas an 
uppercase B means byte.) 

For short distance communication, USB and FireWire provide transfer rates of 
several hundred Mbps, which is sufficient for most multimedia applications. This, 
combined with their convenience and relatively low cost, is why they are popular for 
communication between home computers and local peripherals such as printers, 
external disk drives, and cameras. 

By combining multiplexing (the encoding or interweaving of data so that a sin- 
gle communication path serves the purpose of multiple paths) and data compression 
techniques, traditional voice telephone systems are able to support transfer rates of 
57.6 Kbps, which falls short of the needs of today's multimedia applications. To play 
MP3 music recordings requires a transfer rate of about 64 Kbps, and to play better qual- 
ity video recordings requires transfer rates measured in units of Mbps. This is why 
alternatives such as DSL, cable, and satellite links, which provide transfer rates well 
into the Mbps range, are rapidly replacing traditional telephone systems for long range 
data transfer. 

The maximum rate available in a particular setting depends on the type of the 
communication path and the technology used in its implementation. This maximum 
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rate is often loosely equated to the communication path's bandwidth, although the 
term bandwidth also has connotations of capacity rather than transfer rate. That is, to 
say that a communication path has a high bandwidth (or provides broadband serv- 
ice) means that the communication path has the ability to transfer bits at a high rate 
as well as the capacity to carry large amounts of information simultaneously. 


1. Assume that the machine described in Appendix C uses memory-mapped I/O 
and that the address B5 is the location within the printer port to which data to 
be printed should be sent. 

a. If register 7 contains the ASCII code for the letter A, what machine lan- 
guage instruction should be used to cause that letter to be printed at the 
printer? 

b. If the machine executes a million instructions per second, how many 
times can this character be sent to the printer in one second? 

c. If the printer is capable of printing five traditional pages of text per 
minute, will it be able to keep up with the characters being sent to it in f » ? 

2 Suppose that the hard disk on your personal computer rotates at 3000 revolu- 
tions a minute, that each track contains 16 sectors, and that each sector con- 
tains 1024 bytes. Approximately what communication rate is required 
between the disk drive and the disk controller if the controller is going to 
receive bits from the disk drive as they are read from the spinning disk? 

3. Estimate how long would it take to transfer a 300-page novel encoded in 
ASCII at a transfer rate of 57.6 Kbps. 


2.6 Other Architectures 

'lb broaden our perspective, let us consider some alternatives to the traditional 
machine architecture we have discussed so far. 

Pipelining 

Electric pulses travel through a wire no faster than the speed of light. Since light trav- 
els approximately I foot in a nanosecond (one billionth of a second), it requires at least 
2 nanoseconds for the control unit in the CPU to fetch an instruction from a memory 
cell that is 1 foot away. (The read request must be sent to memory, requiring at least 
1 nanosecond, and the instruction must be sent back to the control unit, requiring at 
least another nanosecond.) Consequently, to fetch and execute an instruction in such 
a machine requires several nanoseconds-which means that increasing the execu- 
tion speed of a machine ultimately becomes a miniaturization problem. 


Questions 
& Exercises 
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The Dual-Core CPU 

As technology provides ways of placing more and more circuitry on a silicon 
chip, the physical distinction between a computer's components diminishes. 

For instance, a single chip might contain a CPU and main memory. This is an 
example of the "system-on-a-chtp" approach in which the goal is to provide an 
entire system in a single device that can be used as an abstract tool in higher 
level designs. In other cases multiple copies of the same circuit are provided 
within a single device. This originally appeared in the form of chips containing 
several independent gates or perhaps multiple flip-flops. Today's state of the art 
allows for more than one entire CPU to be placed on a single chip. This is the 
underlying architecture of devices known as dual-core CPUs, which consist of 
two CPUs residing on the same chip along with shared cache memory. Such 
devices simplify the construction ofMIMD systems and are readily available for 
use in home computers. 


However, increasing execution speed is not the only way to improve a computer's 
performance. The real goal is to improve the machine's throughput, which refers to 
the total amount of work the machine can accomplish in a given amount of time. 

An example of how a computer's throughput can be increased without requiring 
an increase in execution speed involves pipelining, which is the technique of allow- 
ing the steps in the machine cycle to overlap. In particular, while one instruction is 
being executed, the next instruction can be fetched, which means that more than one 
instruction can be in "the pipe" at any one time, each at a different stage of being 
processed. In turn, the total throughput of the machine is increased even though the 
time required to fetch and execute each individual instruction remains the same. (Of 
course, when a JUMP instruction is reached, any gain that would have been obtained 
by prefetching is not realized because the instructions in "the pipe" are not the ones 
needed after all.) 

Modern machine designs push the pipelining concept beyond our simple exam- 
ple. They are often capable of fetching several instructions at the same time and actu- 
ally executing more than one instruction at a time when those instructions do not 
rely on each other. 

Multiprocessor Machines 

Pipelining can be viewed as a first step toward parallel processing, which is the per- 
formance of several activities at the same time. However, true parallel processing 
requires more than one processing unit, resulting in computers known as multi- 
processor machines. 

A variety of computers today are designed with this idea in mind. One strategy 
is to attach several processing units, each resembling the CPU in a single-processor 
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machine, to the same main memory. In this configuration, the processors can proceed 
independently yet coordinate their efforts by leaving messages to one another in the 
common memory cells. For instance, when one processor is faced with a large task, 
it can store a program for part of that task in the common memory and then request 
another processor to execute it. The result is a machine in which different instruction 
sequences are performed on different sets of data, which is called a MIMD (multiple- 
instruction stream, multiple-data stream) architecture, as opposed to the more tradi- 
tional SISD (single-instruction stream, single-data stream) architecture. 

A variation of multiple-processor architecture is to link the processors together so 
that they execute the same sequence of instructions in unison, each with its own set 
of data. This leads to a SIMD (single-instruction stream, multiple-data stream) archi- 
tecture. Such machines arc useful in applications in which the same task must be 
applied to each set of similar items within a large block of data. 

Another approach to parallel processing is to construct large computers as con- 
glomerates of smaller machines, each with its own memory and CPU. Within such an 
architecture, each of the small machines is coupled to its neighbors so that tasks 
assigned to the whole system can be divided among the individual machines. Thus if 
a task assigned to one of the internal machines can be broken into independent sub- 
tasks, that machine can ask its neighbors to perform these subtasks concurrently. The 
original task can then be completed in much less time than would be required by a 
single-processor machine. 

In Chapter 10 we will study yet another multiprocessor architecture, artificial 
neural networks, whose design is based on theories of biological neural systems. These 
machines consist of many elementary processors, or processing units, each of whose 
output is merely a simple reaction to its combined inputs. These simple processors 
are linked to form a network in which the outputs of some processors are used as 
inputs to others. Such a machine is programmed by adjusting the extent to which 
each processor's output is allowed to influence the reaction of those processors to 
which it is connected. This is based on the theory that biological neural networks 
learn to produce a particular reaction to a given stimulus by adjusting the chemical 
composition of the junctions (synapses) between neurons, which in turn adjusts the 
ability of one neuron to affect the actions of others. 

Proponents of artificial neural networks argue that, although technology is 
approaching the ability to construct electronic circuitry with roughly as many switch- 
ing circuits as there are neurons in the human brain (neurons are believed to be 
nature's switching circuits), the capabilities of today's machines still fall far short of 
those of the human mind. This, they argue, is a result of the inefficient use of a tra- 
ditional computer's components as dictated by the von Neumann architecture. After 
all, if a machine is constructed with a lot of memory circuitry supporting a few proces- 
sors, then most of its circuitry is destined to be idle most of the time. In contrast, 
much of the human mind can be active at any given moment. 

Thus, research in computer design is expanding the basic CPU-main memory 
model and in some cases breaking away from it altogether in order to develop more 
useful machines. 
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Questions I Referring back to Question 3 of Section 2.3, if the machine used the pipeline 

& Exercises technique discussed in the text, what will be in "the pipe" when the instruc- 

tion at address AA is executed? Under what conditions would pipelining not 
prove beneficial at this point in the program? 

2 What conflicts must be resolved in running the program in Question 4 of 
Section 2.3 on a pipeline machine? 

3 . Suppose there were two "central" processing units attached to the same 
memory and executing different programs. Furthermore, suppose that one 
of these processors needs to add one to the contents of a memory cell at 
roughly the same time that the other needs to subtract one from the same 
cell. (The net effect should be that the cell ends up with the same value with 
which it started.) 

a. Describe a sequence in which these activities would result in the cell 
ending up with a value one less than its starting value. 

b. Describe a sequence in which these activities would result in the cell 
ending up with a value one greater than its starting value. 


Chapter Review Problems 


(Asterisked problems are associated with optional sections.) 


1. a. In what way are general-purpose registers 
and main memory cells similar? 
b. In what way do general-purpose registers 
and main memory cells differ? 

2 Answer the following questions in terms of the 
machine language described in Appendix C. 

a. Write the instruction 2105 (hexadecimal) as 
a string of 16 bits. 

b. Write the op-code of the instruction A324 
(hexadecimal) as a string of four bits. 

c. Write the operand field of the instruction 
A324 (hexadecimal) as a string of 12 bits. 

3. Suppose a block of data is stored in the 
memory cells of the machine described in 
Appendix C from address B9 to Cl, inclusive. 
How many memory cells are in this block? 
List their addresses. 


4 What is the value of the program counter in 
the machine described in Appendix C imme- 
diately after executing the instruction BOBA? 

5. Suppose the memory cells at addresses 00 
through 05 in the machine described in 
Appendix C contain the following bit patterns: 


Address 

Contents 

00 

21 

01 

04 

02 

31 

03 

00 

04 

00 

05 

00 


Assuming that the program counter initially 
contained 00, record the contents of the pro- 
gram counter, instruction register, and memory 
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cell at address 00 at the end of each fetch phase 
of the machine cycle until the machine halts. 

6. Suppose three values %, y, and z are stored in a 
machine's memory. Describe the sequence of 
events (loading registers from memory, saving 
values in memory, and so on) that leads to the 
computation ofv + y + z. How about (2x) + y? 

7. The following are instructions written in the 
machine language described in Appendix C. 
Translate them into English. 

a. 407E b. 8008 C. A403 

d. 2835 e. B3AD 

8. Suppose a machine language is designed with 
an op-code field of four bits. How many differ- 
ent instruction types can the language con- 
tain? What if the op-code field is increased to 
eight bits? 

9. Translate the following instructions from 
English into the machine language described 
in Appendix C. 

a. LOAD register 7 with the hexadecimal 
value 66. 

b. LOAD register 7 with the contents of 
memory cell 66. 

c. AND the contents of registers F and 2 
leaving the result in register 0. 

d. ROTATE register 4 three bits to the right. 

e. JUMP to the instruction at memory loca- 
tion 31 if the contents of register 0 equals 
the value in register B. 

10. Rewrite the program in Figure 2.7 assuming 
that the values to be added are encoded using 
floating-point notation rather than two's com- 
plement notation. 

11. Classify each of the following instructions (in 
the machine language of Appendix C) in 
terms of whether its execution changes the 
contents of the memory cell at location 3B, 
retrieves the contents of the memory cell at 
location 3B, or is independent of the contents 
of the memory cell at location 3B. 

a. 153B b. 253B c. 353B 

d. 3B3B e. 403B 


12. Suppose the memory cells at addresses 00 
through 03 in the machine described in 
Appendix C contain the following bit patterns: 


Address 

Contents 

00 

24 

01 

05 

02 

GO 

03 

00 


a. Translate the first instruction into English. 

b. If the machine is started with its program 
counter containing 00, what bit pattern is in 
register 4 when the machine halts? 


13. Suppose the memory cells at addresses 00 
through 02 in the machine described in 
Appendix C contain the following bit 
patterns: 

Address Contents 

00 24 

01 IB 

02 34 

a. What would be the first instruction exe- 
cuted if we started the machine with its 
program counter containing 00? 

b. What would be the first instruction exe- 
cuted if we started the machine with its 
program counter containing 01? 


14. Suppose the memory cells at addresses 00 
through 05 in the machine described in 
Appendix C contain the following bit 
patterns: 


Address 

00 

01 

02 

03 

04 

05 


Contents 

10 

04 

30 

45 

CO 

00 


When answering the following questions, 
assume that the machine starts with its pro- 
gram counter equal to 00. 

a. Translate the instructions that are executed 
into English. 
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b. What bit pattern is in the memory cell at 
address 45 when the machine halts? 

c. What bit pattern is in the program counter 
when the machine halts? 

15. Suppose the memory cells at addresses 00 
through 09 in the machine described in 
Appendix C contain the following bit patterns: 


Address 

Contents. 

00 

LA 

01 

02 

02 

2B 

03 

02 

04 

9C 

05 

AB 

06 

3C 

07 

00 

08 

CO 

09 

00 

Assume that the machine starts with its pro- 
gram counter containing 00. 
a. What will be in the memory cell at address 

00 when 

the machine halts? 

b. What bit pattern will be in the program 

counter when the machine halts? 

Suppose the memory cells at addresses 00 
through 07 in the machine described in 
Appendix C contain the following 

bit patterns: 


Address 

Contents; 

00 

1A 

01 

06 

02 

3A 

03 

07 

04 

CO 

05 

00 

06 

23 

07 

00 


a. List the addresses of the memory cells that 
contain the program that will be executed if 
we start the machine with its program 
counter containing 00. 

b. List the addresses of the memory cells that 
are used to hold data. 


1 7. Suppose the memory cells at addresses 00 
through 0D in the machine described in 
Appendix C contain the following bit patterns: 


Address 

Contents ; 

00 

20 

01 

03 

02 

21 

03 

01 

04 

40 

05 

12 

06 

51 

07 

12 

08 

B1 

09 

OC 

OA 

BO 

0B 

06 

OC 

CO 

OD 

00 


Assume that the machine starts with its pro- 
gram counter containing 00. 

a. What bit pattern will be in register 1 when 
the machine halts? 

b. What bit pattern will be in register 0 when 
the machine halts? 

c. What bit pattern is in the program counter 
when the machine halts? 

18. Suppose the memory cells at addresses FO through 
FD in the machine described in Appendix C con- 
tain the following (hexadecimal) bit patterns: 


Address 

Contents • 

FO 

20 

FI 

00 

F2 

21 

F3 

01 

F4 

23 

F5 

05 

F6 

B3 

F7 

FC 

F8 

50 

F9 

01 

FA 

BO 

FB 

F6 

FC 

CO 

FD 

00 
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If we start the machine with its program 
counter containing FO, what is the value in 
register 0 when the machine finally executes 
the halt instruction at location FC? 

19. If the machine in Appendix C executes an 
instruction every microsecond (a millionth of 
a second), how long does it take to complete 
the program in Problem 18? 

20. Suppose the memory cells at addresses 20 
through 28 in the machine described in 
Appendix C contain the following bit 


patterns: 


Address 

Contents 

20 

12 

21 

20 

22 

32 

23 

30 

24 

80 

25 

21 

20 

20 

27 

CD 

28 

00 


Assume that the machine starts with its pro- 
gram counter containing 20. 

a. What bit patterns will be in registers 0, 1, 
and 2 when the machine halts? 

b. What bit pattern will be in the memory cell 
at address 30 when the machine halts? 

c. What bit pattern will be in the memory cell 
at address BO when the machine halts? 

2 1 . Suppose the memory cells at addresses AF 
through B1 in the machine described in 
Appendix C contain the following bit 
patterns: 

Address Contents 

AF BO 

B0 BO 

B1 AF 

What would happen if we started the machine 
with its program counter containing AF? 

22. Suppose the memory cells at addresses 00 
through 05 in the machine described in 


Appendix C contain the following (hexadeci- 
mal) bit patterns: 


Address 

Contents 

00 

25 

01 

B0 

02 

35 

03 

04 

04 

CO 

05 

00 


If we start the machine with its program 
counter containing 00, when does the 
machine halt? 

23. In each of the following cases, write a short 
program in the machine language described in 
Appendix C to perform the requested activi- 
ties. Assume that each of your programs is 
placed in memory starting at address 00. 

a. Move the value at memory location 8D to 
memory location B3. 

b. Interchange the values stored at memory 
locations 8D and B3. 

c. If the value stored in memory location 45 is 
00, then place the value CC in memory 
location 88; otherwise, put the value DD in 
memory location 88. 

24. A game that used to be popular among com- 
puter hobbyists is core wars-a variation of 
battleship. (The term core originates from an 
early memory technology in which 0s and Is 
were represented as magnetic fields in little 
rings of magnetic material. The rings were 
called cores.) The game is played between two 
opposing programs, each stored in different 
locations of the same computer's memory. 

The computer is assumed to alternate 
between the two programs, executing an 
instruction from one followed by an instruc- 
tion from the other. The goal of each program 
is to cause the other to malfunction by writing 
extraneous data on top of it; however, neither 
program knows the location of the other. 

a. Write a program in the machine language 
of Appendix C that approaches the game in 
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a defensive manner by being as small as 
possible. 

b. Write a program in the language of 
Appendix C that tries to avoid any attacks 
from the opposing program by moving to 
different locations. More precisely, write 
your program to start at location 00, copy 
itself to location 70, and then jump to this 
new copy. 

c. Extend the program in (b) to continue relo- 
cating to new memory locations. In particu- 
lar, make your program move to location 
70, then to E0 ( = 70 + 70), then to 60 

{ = 70 + 70 + 70), etc. 

25. Write a program in the machine language of 
Appendix C to compute the sum of the two's 
complement values stored at memory loca- 
tions A 1, A2, A3, andA4. Your program should 
store the total at memory location A5. 

26. Suppose the memory cells at addresses 00 
through 05 in the machine described in 
Appendix C contain the following (hexadeci- 
mal) bit patterns: 


Address 

Contents 

00 

20 

01 

CO 

02 

30 

03 

04 

04 

00 

05 

00 


What happens if we start the machine with its 
program counter containing 00? 

2 7 . What happens if the memory cells at 

addresses 06 and 07 of the machine described 
in Appendix C contain the bit patterns B0 and 
06, respectively, and the machine is started 
with its program counter containing the value 
06? 

28. Suppose the following program, written in the 
machine language of Appendix C, is stored in 
main memory beginning at address 30 (hexa- 
decimal). What task will the program perform 
when executed? 


2003 

2101 

2200 

2310 

1400 

3410 

5221 

5331 

3239 

333B 

B248 

B038 

COOO 

29 . Summarize the steps involved when the 

machine described in Appendix C performs 
an instruction with op-code B. Express your 
answer as a set of directions as though you 
were telling the CPU what to do. 

'30. Summarize the steps involved when the 

machine described in Appendix C performs 
an instruction with op-code 5. Express your 
answer as a set of directions as though you 
were telling the CPU what to do. 

c 3 1 . Summarize the steps involved when the 

machine described in Appendix C performs 
an instruction with op-code 6. Express your 
answer as a set of directions as though you 
were telling the CPU what to do. 

►32. Suppose the registers 4 and 5 in the machine 
described in Appendix C contain the bit pat- 
terns 3C and C8, respectively. What bit pattern 
is left in register 0 after executing each of the 
following instructions: 
a. 5045 b. 6045 c. 7045 

d. 8045 e. 9045 

c 3 3 . Using the machine language described in 

Appendix C, write programs to perform each 
of the following tasks: 

a. Copy the bit pattern stored in memory loca- 
tion 66 into memory location BB. 

b. Change the least significant four bits in the 
memory cell at location 34 to 0s while leav- 
ing the other bits unchanged. 
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c. Copy the least significant four bits from 
memory location A5 into the least signifi- 
cant four bits of location A6 while leaving 
the other bits at location A6 unchanged. 

d. Copy the least significant four bits from 
memory location A5 into the most signifi- 
cant four bits of A5. (Thus, the first four bits 
in A5 will be the same as the last four bits.) 

*34. Perform the indicated operations : 


a. 

111000 

b. 

000100 


mr> i 01 ooi 


> 

o 

o 

0 

o 

c. 

000100 

d. 

111011 


AND 010101 


AND 110101 

e. 

111000 

f. 

000100 


OR 101001 


OK 101010 

A- 

000100 

h. 

111011 


OR 010101 


OR 110101 

i. 

111000 

li 

000100 


XOR 101001 


XOR 101010 

k. 

000100 

1. 

111011 


XOR 310101 


XOR 110101 


•35. identify both the mask and the logical opera- 
tion needed to accomplish each of the follow- 
ing objectives: 

a. Put Os in the middle four bits of an eight-bit 
pattern without disturbing the other bits. 

b. Complement a pattern of eight bits. 

c. Complement the most significant bit of an 
eight-bit pattern without changing the other 
bits. 

d. Put a 1 in the most significant bit of an 
eight-bit pattern without disturbing the 
other bits. 

e. Put Is in all but the most significant bit of 
an eight-bit pattern without disturbing the 
most significant bit. 

*36. Identify a logical operation (along with a cor- 
responding mask) that, when applied to an 
input string of eight bits, produces an output 
string of all Os if and only if the input string is 
10000001. 


*37. Describe a sequence of logical operations 

(along with their corresponding masks) that, 
when applied to an input string of eight bits, 
produces an output byte of all 0s if the input 
string both begins and ends with 1 s. 

Otherwise, the output should contain at least 
one 1, 

*38. What would be the result of performing a four- 
bit left circular shift on the following bit pat- 
terns? 

a. 10101 b. 11110000 c. 001 

d. 101000 e. 00001 

*39. What would be the result of performing a one- 
bit right circular shift on the following bytes 
represented in hexadecimal notation (give 
your answers in hexadecimal notation)? 

a. 3F b. OD c. FF d. 77 

*4 0 . a. What single instruction in the machine lan- 
guage of Appendix C could be used to 
accomplish a three-bit right circular shift of 
register B? 

b. What single instruction in the machine lan- 
guage of Appendix C could be used to 
accomplish a three-bit left circular shift of 
register B? 

M I , Write a program in the machine language of 
Appendix C that reverses the contents of the 
memory cell at address 8C. (That is, the final 
bit pattern at address 8C when read from left 
to right should agree with the original pattern 
when read from right to left.) 

*42. Write a program in the machine language of 
Appendix C that subtracts the value stored at 
A1 from the value stored at address AO and 
places the result at address A2. Assume that 
the values are encoded in two's complement 
notation. 

*43. Can a printer, printing 40 characters per sec- 
ond, keep up with a string of ASCII characters 
(one byte per symbol) arriving serially at the 
rate of 300 bps? What about 1200 bps? 

* 44 . Suppose a person is typing 30 words per 

minute at a keyboard. (A word is considered to 
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be five characters.) If a machine executes 50 
instructions every microsecond (millionth of a 
second), how many instructions does the 
machine execute during the time between the 
typing of two consecutive characters? 

* 45 . Ho w many bits per second must a keyboard 
transmit to keep up with a typist typing 30 
words per minute? (Assume each character is 
encoded in ASCII along with a parity bit and 
each word consists of five characters.) 

" 46 . A communication system capable of transmit- 
ting any sequence of eight different states at 
the rate of at most 300 states per second could 
be used to transfer information at what rate in 
bits per second? 

*47. Suppose the machine described in Appendix C 
communicates with a printer using the tech- 
nique of memory-mapped I/O. Suppose also 
that address FF is used to send characters to 
the printer, and address FE is used to receive 
information about the printer's status. In par- 
ticular, suppose the least significant bit at the 
address FE indicates whether the printer is 
ready to receive another character (with a 0 
indicating "not ready" and a 1 indicating 
"ready"). Starting at address 00, write a 
machine language routine that waits until the 
printer is ready for another character and then 
sends the character represented by the bit pat- 
tern in register 5 to the printer. 


*48. Write a program in the machine language 

described in Appendix C that places Os in all 
the memory cells from address AO through CO 
but is small enough to fit in the memory cells 
from address 00 through 13 (hexadecimal). 

* 49 . Suppose a machine has 20GB of storage space 
available on a hard disk and receives data over 
a telephone connection at the rate of 14,400 
bps. At this rate, how long will it take to fill the 
available storage space? 

*50. Suppose a communication line is being used 
to transmit data serially at 14,400 bps. If a 
burst of interference lasts .01 second, how 
many data bits will be affected? 

•51, Suppose you are given 32 processors, each capa- 
ble of finding the sum of two multidigit num- 
bers in a millionth of a second. Describe how 
parallel processing techniques can be applied to 
find the sum of 64 numbers in only six-mil- 
lionths of a second. How much time does a sin- 
gle processor require to find this same sum? 

*52. Summarize the difference between a CISC 
architecture and a RISC architecture. 

*53. Identify two approaches to increasing through- 
put. 

*54 . Describe how the average of a collection of 
numbers can be computed more rapidly with 
a multiprocessor machine than a single- 
processor machine. 


Social Issues 


The following questions are intended as a guide to the ethical/social/legal issues asso- 
ciated with the field of computing. The goal is not merely to answer these questions. 
You should also consider why you answered as you did and whether your justifications 
are consistent from one question to the next. 

1 . Suppose a computer manufacturer develops a new machine architecture. To 
what extent should the company be allowed to own that architecture? What 
policy would be best for society? 
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2. in a sense, the year 1923 marked the birth of what many now call planned 
obsolescence This was the year that Genera] Motors, led by Alfred Sloan, intro- 
duced the automobile industry to the concept of model years. The idea was to 
increase sales by changing styling rather than necessarily introducing a better 
automobile. Sloan is quoted as saying, "We want to make you dissatisfied with 
your current car so you will buy a new one." To what extent is this marketing 
ploy used today in the computer industry? 

3. Wc often think in terms of how computer technology has changed our soci- 
ety. Many argue, however, that this technology has often kept changes from 
occurring by allowing old systems to survive and, in some cases, become 
more entrenched. For example, would a central government's role in society 
have survived without computer technology? To what extent would central- 
ized authority be present today had computer technology not been available? 
To what extent would we be better or worse off without computer technology? 

4 Is it ethical for an individual to take the attitude that he or she does not need 
to know anything about the internal details of a machine because someone 
else will build it, maintain it, and fix any problems that arise? Does your 
answer depend on whether the machine is a computer, automobile, nuclear 
power plant, or toaster? 

5. Suppose a manufacturer produces a computer chip and later discovers a flaw 
in its design. Suppose further that the manufacturer corrects the flaw in 
future production but decides to keep the original flaw a secret and does not 
recall the chips already shipped, reasoning that none of the chips already in 
use are being used in an application in which the flaw will have conse- 
quences. Is anyone hurt by the manufacturer's decision? Is the manufac- 
turer's decision justified if no one is hurt and the decision keeps the 
manufacturer from loosing money and possibly having to layoff employees? 

6 Does advancing technology provide cures for heart disease or is it a source of 
a sedentary life style that contributes to heart disease? 

7. It is easy to imagine financial or navigational disasters that may occur as the 
result of arithmetic errors due to overflow and truncation problems. What 
consequences could result from errors in image storage systems due to loss of 
image details (perhaps in fields such as reconnaissance or medical diagnosis)? 
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Operating 

Systems 


In this chapter we study operating sys- 
tems, which are software packages that 
coordinate a computer's internal activi- 
ties as well as oversee its communication 
with the outside world. It is a computer's 
operating system that transforms the 
computer hardware into a useful tool. 
Our goal is to understand what operating 
systems do and how they do it. Such a 
background is central to being an 
enlightened computer user 



3.1 The History of Operating Systems 

3.2 Operating System Architecture 

A Software Survey 

Components of an Operating System 
Getting It Started 

3.3 Coordinating the Machine’s 
Activities 

The Concept of a Process 
Process Administration 

*3.4 Handling Competition Among 
Processes 

Semaphores 

Deadlock 

3.5 Security 

Attacks from the Outside 
Attacks from Within 

* Asterisks indicate suggestions for 
optional sections. 
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An operating system is the software that controls the overall operation of a com- 
puter. It provides the means by which a user can store and retrieve files, provides the 
interface by which a user can request the execution of programs, and provides the 
environment necessary to execute the programs requested. 

Perhaps the best known example of an operating system is Windows, which is pro- 
vided in numerous versions by Microsoft and widely used in the PC arena. Another 
well-established example is UNIX, which is a popular choice for larger computer sys- 
tems as well as PCs. In fact, UNIX is the core of Mac OS, which is the operating sys- 
tem provided by Apple for its range of Mac machines. Still another example found on 
both large and small machines is Linux, which was originally developed noncom- 
mercially by computer enthusiasts and is now available through many commercial 
sources, including IBM. 


3.1 The History of Operating Systems 

Today's operating systems are large, complex software packages that have grown from 
humble beginnings. The computers of the 1940s and 1950s were not very flexible or 
efficient. Machines occupied entire rooms. Program execution required significant 
preparation of equipment in terms of mounting magnetic tapes, placing punched 
cards in card readers, setting switches, and so on. The execution of each program, 
called a job, was handled as an isolated activity-the machine was prepared for exe- 
cuting the program, the program was executed, and then all the tapes, punched cards, 
etc. had to be retrieved before the next program preparation could begin. When sev- 
eral users needed to share a machine, sign-up sheets were provided so that users 
could reserve the machine for blocks of time. During the time period allocated to a 
user, the machine was totally under that user's control. The session usually began 
with program setup, followed by short periods of program execution. It was often 
completed in a hurried effort to do just one more thing ("It will only take a minute") 
while the next user was impatiently starting to set up. 

In such an environment, operating systems began as systems for simplifying pro- 
gram setup and for streamlining the transition between jobs. One early development 
was the separation of users and equipment, which eliminated the physical transition 
of people in and out of the computer room. For this purpose a computer operator was 
hired to operate the machine. Anyone wanting a program run was required to submit 
it, along with any required data and special directions about the program's require- 
ments, to the operator and return later for the results. The operator, in turn, loaded 
these materials into the machine's mass storage where a program called the operat- 
ing system could read and execute them one at a time. This was the beginning of 
batch processing-the execution of jobs by collecting them in a single batch, then exe- 
cuting them without further interaction with the user. 

In batch processing systems, the jobs residing in mass storage wait for execution 
in a job queue (Figure 3.1). A queue is a storage organization in which objects (in 
this case, jobs) are ordered in first-in, first-out (abbreviated FIFO and pronounced 


3.1 The History of Operating Systems 


1 37 


Figure 3.1 Batch processing 


Jobs: Program, data, Results 



"Fl-foe") fashion. That is, the objects are removed from the queue in the order in 
which they arrived. In reality, most job queues do not rigorously follow the FIFO 
structure, since most operating systems provide for consideration of job priorities. As 
a result, a job waiting in the job queue can be bumped by a higher-priority job. 

In early batch processing systems, each job was accompanied by a set of instruc- 
tions explaining the steps required to prepare the machine for that particular job. 
These instructions were encoded, using a system known as a job control language 
(JCL), and stored with the job in the job queue. When the job was selected for exe- 
cution, the operating system printed these instructions at a printer where they could 
be read and followed by the computer operator. This communication between the 
operating system and the computer operator is still seen today, as witnessed by PC 
operating systems that report such errors as "no dial tone," "disk drive not accessi- 
ble," and "printer not responding." 


Beneficial Uniformity or Detrimental Monopoly? 

At first glance, it seems reasonable that the use of a single, standard operating 
system across a wide range of machines would be a good thing. Such a standard 
would mean that operating skills learned on one computer could easily be 
transferred to other computers. Moreover, developers of application software 
would not have to develop products that were compatible with multiple operating 
system designs. However, these arguments overlook many of the realities 
of today's society. The producer of a universal operating system would have 
tremendous power in the marketplace. If misused, this power could potentially 
be more harmful than beneficial to the users of computers. Many of these 
issues have been documented by the parties involved in antitrust lawsuits 
against Microsoft in the United States and Europe. 
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A major drawback to using a computer operator as an intermediary between a 
computer and its users is that the users have no interaction with their jobs once they 
are submitted to the operator. This approach is acceptable for some applications, such 
as payroll processing, in which the data and all processing decisions are established 
in advance. However, it is not acceptable when the useT must interact with a program 
during its execution. Examples include reservation systems in which reservations and 
cancellations must be reported as they occur; word processing systems in which doc- 
uments are developed in a dynamic write and rewrite manner; and computer games 
in which interaction with the machine is the central feature of the game. 

To accommodate these needs, new operating systems were developed that allowed 
a program being executed to carry on a dialogue with the user through remote tenni- 
nals-a feature known as interactive processing (Figure 3.2). (In those days terminals, 
also called workstations, consisted of little more than an electronic typewriter with which 
the user could type input and read the computer's response that was printed on paper.) 

Paramount to successful interactive processing is that the actions of the com- 
puter be sufficiently fast to coordinate with the needs of the user rather than forcing 
the user to conform to the machine's timetable. (The task of processing payroll can 
be scheduled to conform with the amount of time required by the computer, but using 
a word processor would be frustrating if the machine did not respond promptly as 
characters are typed.) Providing computer services in such a timely manner became 
known as real-time processing, and the actions performed were said to occur in 
real-time. That is, to say that a computer performs a task in real time means that the 
computer performs the task quickly enough that it is able to keep up with activities 
in its external (real-world) environment. 

If interactive systems had been required to serve only one user at a time, real-time 
processing would have been no problem. But computers in the 1960s and 1970s were 
expensive, so each machine had to serve more than one user. In turn, it was com- 
mon for several users, working at remote terminals, to seek interactive service from 
a machine at the same time, and real-time considerations presented obstacles. If the 
operating system insisted on executing only one job at a time, only one user would 
receive satisfactory real-time service. 


Figure 3.2 Interactive processing 


User domain 


Machine 

domain 


Programs, data, 
directions, and results 
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A solution to this problem was to design the operating system so that it rotated 
the various jobs in and out of execution by a strategy called time-sharing, which 
is the technique of dividing time into intervals and then restricting the execution 
of a job to only one interval at a time. At the end of each interval, the current job 
is temporarily set aside and another is allowed to execute during the next interval. 
By rapidly shuffling the jobs back and forth in this manner, the illusion of several 
jobs executing simultaneously is created. Depending on the types of jobs being exe- 
cuted, early time-sharing systems were able to provide acceptable real-time pro- 
cessing to as many as 30 users simultaneously. Today, time-sharing is used in 
single-user as well as multiuser systems, although in the former it is usually called 
multitasking, in reference to the illusion of more than one task being performed 
simultaneously. 

With the development of multiuser, time-sharing operating systems, a typical 
computer installation was configured as a large central computer connected to numer- 
ous workstations. From these workstations, users could communicate directly with the 
computer from outside the computer room rather than submitting requests to a com- 
puter operator. Commonly used programs were stored in the machine's mass storage 
devices and operating systems were designed to execute these programs as requested 
from the workstations. In turn, the role of a computer operator as an intermediary 
between the users and the computer begin to fade. 

Today, the existence of a computer operator has essentially disappeared, espe- 
cially in the arena of personal computers where the computer user assumes all of 
the responsibilities of computer operation. Even most large computer installations 
run essentially unattended. Indeed, the job of computer operator has given way to that 
of a system administrator who manages the computer system-obtaining and over- 
seeing the installation of new equipment and software, enforcing local regulations 
such as the issuing of new accounts and establishing mass storage space limits for 
the various users, and coordinating efforts to resolve problems that arise in the sys- 
tem-rather than operating the machines in a hands-on manner. 

In short, operating systems have grown from simple programs that retrieved and 
executed programs one at a time into complex systems that coordinate time-sharing, 
maintain programs and data files in the machine's mass storage devices, and respond 
directly to requests from the computer's users. 

But the evolution of operating systems continues. The development of multi- 
processor machines has led to operating systems that perform multitasking by assigning 
different tasks to different processors rather than by sharing the time of a single 
processor. These operating systems must wrestle with such problems as load bal- 
ancing (dynamically allocating tasks to the various processors so that all processors 
are used efficiently) as well as scaling (breaking tasks into a number of subtasks com- 
patible with the number of processors available). Moreover, the advent of computer 
networks in which numerous machines are connected over great distances has led to 
the necessity for software systems to coordinate the network's activities. Thus the 
field of networking (which we will study in Chapter 4) is in many ways an extension 
of the subject of operating systems-the goal being to develop a single network-wide 
operating system rather than a network of individual operating systems. 
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Questions 
& ExerCi$e$ 


1. Identify examples of queues. In each case, indicate any situations that vio- 

1 a 1 e 1 h e F 1 F 0 structure. 

2. Which of the following would require real-time processing? 

a. Printing mailing labels 

b. Playing a computer game 

c. Displaying letters on a monitor screen as they are typed at the keyboard 

d. Executing a program that predicts the state of next year's economy 

3 What is the difference between real-time processing and interactive processing? 
4. What is the difference between time-sharing and multitasking? 


3.2 Operating System Architecture 

To understand the composition of a typical operating system, we first consider the 
complete spectrum of software found within a typical computer system. Then we 
will concentrate on the operating system itself. 

A Software Survey 

We approach our survey of the software found on a typical computer system by pre- 
senting a scheme for classifying software. Such classification schemes invariably place 
similar software units in different classes in the same manner as the assignment of 
time zones dictates that nearby communities must set their clocks an hour apart even 
though there is no significant difference between the occurrence of sunrise and sun- 
set. Moreover, in the case of software classification, the dynamics of the subject and 
the lack of a definitive authority lead to contradictory terminology. For example, users 
of Microsoft's Windows operating systems will find program groups called "Acces- 
sories" and "Administrative Tools" that include software from both the application and 
utility classes. The following classification should therefore be viewed as a means of 
gaining a foothold in a extensive, dynamic subject rather than as a statement of uni- 
versally accepted fact. 

Let us begin by dividing a machine's software into two broad categories: appli- 
cation software and system software (Figure 3.3}. Application software consists of 
the programs for performing tasks particular to the machine's utilization. A machine 
used to maintain the inventory for a manufacturing company will contain different 
application software from that found on a machine used by an electrical engineer. 
Examples of application software include spreadsheets, database systems, desktop 
publishing systems, accounting systems, program development software, and games. 

In contrast to application software, system software performs those tasks that are 
common to computer systems in general. In a sense, the system software provides the 
infrastructure that the application software requires, in much the same manner as a 
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Figure 3.3 Software classification 



nation's infrastructure (government, roads, utilities, financial institutions, etc.) pro- 
vides the foundation on which its citizens rely for their individual lifestyles. 

Within the class of system software are two categories: one is the operating sys- 
tem itself and the other consists of software units collectively known as utility soft- 
ware. The majority of an installation's utility software consists of programs for 
performing activities that are fundamental to computer installations but not included 
in the operating system. In a sense, utility software consists of software units that 
extend (or perhaps customize) the capabilities of the operating system. For example, 
the ability to format a magnetic disk or to copy a file from a magnetic disk to a CD is 
often not implemented within the operating system itself but instead is provided by 
means of a utility program. Other instances of utility software include software to com- 
press and decompress data, software for playing multimedia presentations, and soft- 
ware for handling network communication. 

Implementing certain activities as utility software, allows system software to be 
customized to the needs of a particular installation more easily than if they were 
included in the operating system. Indeed, it is common to find companies or indi- 
viduals who have modified, or added to, the utility software that was originally pro- 
vided with their machine's operating system. 

Unfortunately, the distinction between application software and utility software can 
be vague. From our point of view, the difference is whether the package is part of the com- 
puter's software infrastructure. Thus a new application may evolve to the status of a util- 
ity if it becomes a fundamental tool. When still a research project, software for 
communicating over the Internet was considered application software; today such tools 
are fundamental to most PC usage and would therefore be classified as utility software. 
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Linux 

For the computer enthusiast who wants to experiment with the internal compo- 
nents of an operating system, there is Linux. Linux is an operating system origi- 
nally designed by Linus Torvalds while a student at the University of Helsinki. 

It is a nonproprietary product and available, along with its source code (see 
Chapter 6) and documentation, without charge. Because it is freely available in 
source code form, it has become popular among computer hobbyists, students 
of operating systems, and programmers in general. Moreover, Linux is recog- 
nized as one of the most reliable operating systems available today. For this rea- 
son, several companies now package and market versions of Linux in an easily 
useable form, and these products are now challenging the long-established com- 
mercial operating systems on the market. You can learn more about Linux from 
the website at ht tp : / / www. 1 inux. org . 


The distinction between utility software and the operating system is equally 
vague. In particular, anti-trust lawsuits in the United States and Europe have been 
founded on questions regarding whether units such as browsers and media players are 
components of Microsoft's operating systems or utilities that Microsoft has included 
merely to squash competition. 

Components of an Operating System 

Let us focus now on components that are within the domain of an operating system. 
In order to perform the actions requested by the computer's users, an operating system 
must be able to communicate with those users. The portion of an operating system 
that handles this communication is often called the shell. Modern shells perform this 
task by means ofa graphical user interface (GUI-pronounced "GOO-ee") in which 
objects to be manipulated, such as files and programs, are represented pictorially on the 
monitor screen as icons. These systems allow users to issue commands to the operating 
system by pointing to these icons by means of a hand-held device called a mouse and 
pressing a button on the mouse (a process called clicking). Older shells communicate 
with users through textual messages using a keyboard and monitor screen. 

Although an operating system's shell plays an important role in establishing a 
machine's functionality, this shell is merely an interface between a user and the real 
heart of the operating system (Figure 3.4). This distinction between the shell and the 
internal parts of the operating system is emphasized by the fact that some operating 
systems allow a user to select among different shells to obtain the most compatible 
interface for that particular user. Users of the UNIX operating system, for example, can 
select among a variety of shells including the Bourne shell, the C shell, and the Korn 
shell. Moreover, early versions of Microsoft Windows were constructed by essentially 
replacing the text-based shell that was currently used with the operating system called 
MS-DOS with a GUI shell-the underlying operating system remained MS-DOS. 
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Figure 3.4 The shell as an interface between users and the operating system 
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An important component within today's GUI shells is the window manager, 
which allocates blocks of space on the screen, called windows, and keeps track of 
which application is associated with each window. When an application wants to dis- 
play something on the screen, it notifies the window manager, and the window man- 
ager places the desired image in the window assigned to the application. In turn, 
when a mouse button is clicked, it is the window manager that computes the mouse's 
location on the screen and notifies the appropriate application of the mouse action. 

In contrast to an operating system's shell, the internal part of an operating sys- 
tem is called the kernel. An operating system's kernel contains those software com- 
ponents that perform the very basic functions required by the computer installation. 
One such unit is the file manager, whose job is to coordinate the use of the machine's 
mass storage facilities. More precisely, the file manager maintains records of all the 
files stored in mass storage, including where each file is located, which users are 
allowed to access the various files, and which portions of mass storage are available 
for new files or extensions to existing files. These records are kept on the individual 
storage medium containing the related files so that each time the medium is placed 
on-line, the file manager can retrieve them and thus know what is stored on that par- 
ticular medium. 

For the convenience of the machine's users, most file managers allow files to be 
grouped into a bundle called a directory or folder. This approach allows a user to organ- 
ize his or her files according to their purposes by placing related files in the same direc- 
tory. Moreover, by allowing directories to contain other directories, called subdirectories, 
a hierarchical organization can be constructed. For example, a user may create a direc- 
tory called MyRecords that contains subdirectories called FinancialRecords , Med- 
icalRecords , and HouseHoldRecords . Within each of these subdirectories couldbe 
files that fall within that particular category. (Users of a Windows operating system can 
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ask the file manager to display the current collection of folders by executing the program 
Windows Explorer.) 

A chain of directories within directories is called a directory path. Paths are often 
expressed by listing the directories along the path separated by slashes. For instance, 
animals/prehistoric/dinosaurs would represent the path starting at the direc- 
tory named animals, passing through its subdirectory named prehi storic , and 
terminating in the sub-subdirectory dinosaurs. (For Windows users the slashes in 
such a path expression are reversed as in animals\prehistoric\dinosaurs.) 

Any access to a file by other software units is obtained at the discretion of the file 
manager. The procedure begins by requesting that the file manager grant access to the 
file through a procedure known as opening the file. If the file manager approves the 
requested access, it provides the information needed to find and to manipulate the file. 
This information is stored in an area of main memory called a file descriptor. It is 
by referencing the information in this file descriptor that individual operations are per- 
formed on the file. 

Another component of the kernel consists of a collection of device drivers, which 
are the software units that communicate with the controllers (or at times, directly 
with peripheral devices) to carry out operations on the peripheral devices attached to 
the machine. Each device driver is uniquely designed for its particular type of device 
(such as a printer, disk drive, or monitor) and translates generic requests into the 
more technical steps required by the device assigned to that driver. For example, a 
device driver for a printer contains the software for reading and decoding that par- 
ticular printer's status word as well as all the other handshaking details. Thus, otheT 
software components do not have to deal with those technicalities in order to print a 
file. Instead, the other components can merely Tely on the device driver software to 
print the file, and let the device driver take care of the details. In this manner, the 
design of the other software units can be independent of the unique characteristics 
of particular devices. The result is a generic operating system that can be customized 
for particular peripheral devices by merely installing the appropriate device drivers. 

Still another component of an operating system's kernel is the memory manager, 
which is charged with the task of coordinating the machine's use of main memory. 
Such duties are minimal in an environment in which a computer is asked to perform 
only one task at a time. In these cases, the program for performing the current task 
is placed at a predetermined location in main memory, executed, and then replaced 
by the program for performing the next task. However, in multiuser or multitasking 
environments in which the computer is asked to address many needs at the same 
time, the duties of the memory manager are extensive. In these cases, many pro- 
grams and blocks of data must reside in main memory concurrently. Thus, the mem- 
ory manager must find and assign memory space for these needs and ensure that the 
actions of each program are restricted to the program's allotted space. Moreover, as the 
needs of different activities come and go, the memory manager must keep track of 
those memory areas no longer occupied. 

The task of the memory manager is complicated further when the total main mem- 
ory space required exceeds the space actually available in the computer. In this case the 
memory manager may create the illusion of additional memory space by rotating pro- 
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grams and data back and forth between main memory and mass storage (a technique 
called paging). Suppose, for example, that a main memory of 1024MB is required but 
the computer only has 512MB. Tb create the illusion of the larger memory space, the 
memory manager reserves 1024MB of storage space on a magnetic disk. There it records 
the bit patterns that would be stored in main memory if main memory had an actual 
capacity of 1024MB. This data is divided into uniform sized units called pages, which 
are typically a few KB in size. Then the memory manager shuffles these pages back and 
forth between main memory and mass storage so that the pages that are needed at any 
given time are actually present in the 512MB of main memory. The result is that the 
computer is able to function as though it actually had 1024MB of main memory. This 
large "fictional" memory space created by paging is called virtual memory. 

Two additional components within the kernel of an operating system are the 
scheduler and dispatcher, which we will study in the next section. For now we 
merely note that in a time-sharing system the scheduler determines which activities 
are to be considered for execution, and the dispatcher controls the allocation of time 
to these activities. 

Getting It Started 

We have seen that an operating system provides the software infrastructure required 
by other software units, but we have not considered how the operating system itself 
gets started. This is accomplished through a procedure known as boot strapping 
(often shortened to booting) that is performed by a computer each time it is turned 
on. It is this procedure that transfers the operating system from mass storage (where 
it is permanently stored) into main memory (which is essentially empty when the 
machine is first turned on). To understand the boot strap process and the reason it is 
necessary, we begin by considering the machine's CPU. 

A CPU is designed so that its program counter starts with a particular predeter- 
mined address each time the CPU is turned on. It is at this location that the CPU 
expects to find the beginning of the program to be executed. Conceptually, then, all 
that is needed is to store the operating system at this location. However, for both eco- 
nomic and efficiency reasons, a computer's main memory is typically constructed 
from volatile technologies-meaning that the memory loses the data stored in it when 
the computer is turned off. Thus, we need a means of replenishing main memory 
each time the computer is restarted. 

To this end, a small portion of a computer's main memory where the CPU expects 
to find its initial program is constructed from special nonvolatile memory cells. Such 
memory is known as read-only memory (ROM) since its contents can be read but 
not altered. As an analogy, you can think of storing bit patterns in ROM as blowing 
tiny fuses, although the technology used is more advanced. More precisely, most 
ROM in today's PCs'is constructed with flash memory technology (which means that 
it is not strictly ROM since it can be altered under special circumstances). 

The program stored in ROM is called the bootstrap. This, then, is the program 
that is executed automatically when the machine is turned on. Its task is to direct the 
CPU to transfer the operating system from a predetermined location in mass storage 
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Figure 3.5 
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(typically a magnetic disk) into the volatile area of main memory (Figure 3.5). Once 
the operating system has been placed in main memory, the bootstrap directs the CPU 
to execute a jump instruction to that area of memory. At this point, the operating sys- 
tem takes over and begins controlling the machine's activities. 

You may ask why computers are not provided with enough ROM to hold the entire 
operating system so that booting from mass storage would not be necessary. The answer 
is that devoting large blocks of main memory in general-purpose computers to nonvolatile 
storage is not efficient with today's technology. On the Other hand, most special-purpose 
computers, such as those in household appliances, have all of their software permanently 
stored in their main memories where it is readily available each time the device is turned 


BIOS 


In addition to the bootstrap, the ROM in a PC contains a collection of software 
routines for performing fundamental input/output activities such as receiving 
information from the keyboard, displaying messages on the computer screen, 
and reading data from mass storage. Being stored in ROM, these routines can be 
used by the bootstrap to perform I/O activities before the operating system 
becomes functional. For example, they are used to communicate with the com- 
puter user before the boot process actually begins and to report errors during 
bootstrapping. Collectively these routines form a basic input/output system 
(BIOS, pronounced "BYE-os"). Thus the term BIOS actually refers only to a por- 
tion of the software in a computer's ROM, although the term is widely used 
today in reference to the entire collection of software stored in ROM and some- 
times to the ROM itself. 
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on. Such systems are known as turn key systems since they are ready to function with 
the flip of a switch or the turn of a key. With the rapid advances that are being made in 
memory technology, it may soon be that many of the steps in the booting process will 
become obsolete, and that general purpose computers will approach turn key status. 


L List the components of a typical operating system and summarize the role of 
each in a single phrase. 

2. What is the difference between application software and utility software? 

3. What is virtual memory? 

4. Summarize the booting procedure. 

3.3 Coordinating the Machine's Activities 

In this section we consider how an operating system coordinates the execution of 
application software, utility software, and units within the operating system itself. We 
begin with the concept of a process. 

The Concept of a Process 

One of the most fundamental concepts of modern operating systems is the distinction 
between a program and the activity of executing a program. The former is a static set 
of directions, whereas the latter is a dynamic activity whose properties change as 
time progresses. This activity is known as a process. Associated with a process is the 
current status of the activity, called the process state. This state includes the current 
position in the program being executed (the value of the program counter) as well as 
the values in the other CPU registers and the associated memory cells. Roughly speak- 
ing, the process state is a snapshot of the machine at a particular time. At different 
times during the execution of a program (at different times in a process) different 
snapshots (different process states) will be observed. 

In a typical time-sharing computer installation, many processes are normally 
competing for the computer's resources. It is the task of the operating system to man- 
age these processes so that each process has the resources (peripheral devices, space 
in main memory, access to files, and access to a CPU) that it needs, that independent 
processes do not interfere with one another, and that processes that need to exchange 
information are able to do so. 


Process Administration 

The tasks associated with coordinating the execution of processes are handled by the 
scheduler and dispatcher within the operating system's kernel. The scheduler main- 
tains a record of the processes present in the computer system, introduces new 
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interrupts 

The use of interrupts for terminating time slices, as described in the text, is 
only one of many applications of a computer's interrupt system. There are 
many situations in which an interrupt signal is generated, each with its own 
interrupt routine. Indeed, interrupts provide an important tool for coordinating 
a computer’s actions with its environment. For example, both clicking a mouse 
and pressing a key on the keyboard generate interrupt signals that cause the 
CPU to set aside its current activity and address the cause of the interrupt. 

To manage the task of recognizing and responding to incoming interrupts, 
the various interrupt signals are assigned priorities so that the more important 
tasks can be taken care of first. The highest priority interrupt is usually associ- 
ated with a power failure. Such an interrupt signal is generated if the computer's 
power is unexpectedly disrupted. The associated interrupt routine directs the 
CPU through a series of "housekeeping" chores during the milliseconds before 
the voltage level drops below an operational level. 


processes to this pool, and removes completed processes from the pool. Thus when 
a user requests the execution of an application, it is the scheduler that adds the exe- 
cution of that application to the pool of current processes. 

Tbkeep track of all the processes, the scheduler maintains a block of information 
in main memory called the process table. Each time the executionof a program is 
requested, the scheduler creates a new entry for that process in the process table. 
This entry contains such information as the memory area assigned to the process 
(obtained from the memory manager), the priority of the process, and whether the 
process is ready or waiting. A process is ready if it is in a state in which its progress 
can continue; it is waiting if its progress is currently delayed until some external 
event occurs, such as the completion of a disk access, the pressing of a key at the key- 
board, or the arrival of a message from another process. 

The dispatcher is the component of the kernel that ensures that the scheduled 
processes are actually executed. In a time-sharing system this task is accomplished 
by time-sharing; that is, dividing time into short segments, each called a time slice 
(typically no more than 50 milliseconds), and then switching the CPU's attention 
among the processes as each is allowed to execute for one time slice (Figure 3.6). The 
procedure of changing from one process to another is called a process switch (or a 
context switch). 

Each time the dispatcher awards a time slice to a process, it initiates a timer cir- 
cuit that will indicate the end of the slice by generating a signal called an interrupt. 
The CPU reacts to this interrupt signal in much the same way that you react when 
interrupted from a task. You stop what you are doing, record where you are in the task 
(so that you will be able to return at a later time), and take care of the interrupting 
entity. When the CPU receives an interrupt signal, it completes its current machine 
cycle, saves its position in the current process and begins executing a program, called 
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Figure 3.6 Time-sharing between process A and process B 
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an interrupt handler, which is stored at a predetermined location in main memory. 
This interrupt handler is a part of the dispatcher, and it describes how the dispatcher 
should respond to the interrupt signal. 

Thus, the effect of the interrupt signal is to preempt the current process and 
transfer control back to the dispatcher. At this point, the dispatcher first allows the 
scheduler to update the process table (for instance, the priority of the process that has 
just completed its time slice may need to be lowered and the priorities of other 
processes may need to be raised). Then, the dispatcher selects the process from the 
process table that has the highest priority among the ready processes, restarts the 
timer circuit, and allows the selected process to begin its time slice. 

Paramount to the success of a time-sharing system is the ability to stop, and later 
restart, a process. If you are interrupted while reading a book, your ability to con- 
tinue reading at a later time depends on your ability to remember your location in the 
book as well as the information that you had accumulated to that point. In short, you 
must be able to re-create the environment that was present immediately prior to the 
interruption. 

In the case of a process, the environment that must be re-created is the process's 
state. Recall that this state includes the value of the program counter as well as the 
contents of the registers and pertinent memory cells. CPUs designed for time-sharing 
systems incorporate the task of saving this information as part of the CPU's reaction 
to the interrupt signal. These CPUs also tend to have ma chine-language instructions 
for reloading a previously saved state. Such features simplify the task of the dispatcher 
when performing a process switch and exemplify how the design of modern CPUs is 
influenced by the needs of today's operating systems. 

In closing, we should note that the use of time- sharing has been found to increase 
the overall efficiency of a machine. This is somewhat counterintuitive since the shuf- 
fling of processes required by time-sharing introduces an overhead. However, with- 
out time-sharing each process runs to completion before the next process begins. 
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meaning that the time that a process is waiting for peripheral devices to complete 
tasks or for a user to make the next request is wasted. Time-sharing allows this lost 
time to be given to another process. For example, if a process executes an I/O request, 
such as a request to retrieve data from a disk, the scheduler will update the process 
table to reflect that the process is waiting for an external event. In turn, the dispatcher 
will cease to award time slices to that process. Later (perhaps several hundred mil- 
liseconds), when the I/O request has been completed, the scheduler will update the 
process table to show that the process is ready, and thus that process will again com- 
pete for time slices. In short, progress on other tasks is being made while the I/O 
request is being performed, and thus the entire collection of tasks will be completed 
in less time than if executed in a sequential manner. 


Questions 
& Exercises 


1. Summarize the difference between a program and a process. 

2. Summarize the steps performed by the CPU when an interrupt occurs. 

3 In a time-sharing system, how can high-priority processes be allowed to run 
faster than others? 

4. If each time slice in a time-sharing system is 50 milliseconds and each con- 
text switch requires at most a microsecond, how many processes can the 
machine service in a single second? 

5 . If each process uses its complete time slice in the machine in Question/ 
Exercise 4, what fraction of the machine's time is spent actually performing 
processes? What would this fraction be if each process executed an I/O 
request after only a microsecond of its time slice? 


3.4 Handling Competition Among Processes 

An important task of an operating system is the allocation of the machine's resources 
to the processes in the system. Here we are using the term resource in a broad sense, 
including the machine's peripheral devices as well as features within the machine 
itself. The file manager allocates access to files as well and allocates mass storage 
space for the construction of new files; the memory manager allocates memory space; 
the scheduler allocates space in the process table; and the dispatcher allocates time 
slices. As with many problems in computer systems, this allocation task may appear 
simple at first glance. Below the surface, however, lie several subtleties that can lead 
to malfunctions in a poorly designed system. Remember, a machine does not think 
for itself; it merely follows directions. Thus, to construct reliable operating systems, 
we must develop algorithms that cover every possible contingency, regardless of how 
minuscule it may appear. 
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Semaphores 

Let us consider a time-sharing operating system controlling the activities of a computer 
with a single printer. If a process needs to print its results, it must request that the oper- 
ating system give it access to the printer's device driver. At this point, the operating 
system must decide whether to grant this request, depending on whether the printer 
is already being used by another process. If it is not, the operating system should 
grant the request and allow the process to continue; otherwise, the operating system 
should deny the request and perhaps classify the process as a waiting process until 
the printer becomes available. After all, if two processes were given simultaneous 
access to the computer's printer, the results would be worthless to both. 

To control access to the printer, the operating system must keep track of whether 
the printer has been allocated. One approach to this task would be to use a flag, which 
in this context refers to a bit in memory whose states are often referred to as set and 
clear, rather than 1 and 0. A clear flag (value 0) indicates that the printer is available 
and a set flag (value 1) indicates that the printer is currently allocated. On the surface, 
this approach seems well-founded. The operating system merely checks the flag each 
time a request for printer access is made. If it is clear, the request is granted and the 
operating system sets the flag. If the flag is set, the operating system makes the 
requesting process wait. Each time a process finishes with the printer, the operating 
system either allocates the printer to a waiting process or, if no process is waiting, 
merely clears the flag. 

However, this simple flag system has a problem. The task of testing and possibly 
setting the flag may require several machine instructions. (The flag must be retrieved 
from main memory, manipulated within the CPU, and finally stored back in memory.) 
It is therefore possible for a task to be interrupted after a clear flag has been detected 
but before the flag has been set. In particular, suppose the printer is currently avail- 
able, and a process requests use of it. The flag is retrieved from main memory and 
found to be clear, indicating that the printer is available. However, at this point, the 
process is interrupted and another process begins its time slice. It too requests the use 
of the printer. Again, the flag is retrieved from main memory and found still clear 
because the previous process was interrupted before the operating system had time to 
set the flag in main memory. Consequently, the operating system allows the second 
process to begin using the printer. Later, the original process resumes execution where 
it left off, which is immediately after the operating system found the flag to be clear. Thus 
the operating system continues by setting the flag in main memory and granting the 
original process access to the printer. Two processes are now using the same printer. 

The solution to this problem is to insist that the task of testing and possibly set- 
ting the flag be completed without interruption. One approach is to use the interrupt 
disable and interrupt enable instructions provided in most machine languages. When 
executed, an interrupt disable instruction causes future interrupts to be blocked, 
whereas an interrupt enable instruction causes the CPU to resume responding to 
interrupt signals. Thus, if the operating system starts the flag-testing routine with a 
disable interrupt instruction and ends it with an enable interrupt instruction, no other 
activity can interrupt the routine once it starts. 
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Another approach is to use the test-and-set instruction that is available in many 
machine languages. This instruction directs the CPU to retrieve the value of a flag, note 
the value received, and then set the flag-all within a single machine instruction. The 
advantage here is that because the CPU always completes an instruction before rec- 
ognizing an interrupt, the task of testing and setting the flag cannot be split when it 
is implemented as a single instruction. 

A properly implemented flag, as just described, is called a semaphore, in refer- 
ence to the railroad signals used to control access to sections of track. In fact, sema- 
phores are used in software systems in much the same way as they are in railway 
systems. Corresponding to the section of track that can contain only one train at a time 
is a sequence of instructions that should be executed by only one process at a time. 
Such a sequence of instructions is called a critical region. The requirement that 
only one process at a time be allowed to execute a critical region is known as mutual 
exclusion. In summary, a common way of obtaining mutual exclusion to a critical 
region is to guard the critical region with a semaphore. To enter the critical region, a 
process must find the semaphore clear and then set the semaphore before entering 
the critical region; then upon exiting the critical region, the process must clear the 
semaphore. If the semaphore is found in its set state, the process trying to enter the 
critical region must wait until the semaphore has been cleared. 


Deadlock 

Another problem that can arise during resource allocation is deadlock, the condi- 
tion in which two or more processes are blocked from progressing because each is wait- 
ing for a resource that is allocated to another. For example, one process may have 
access to the computer's printer but be waiting for access to the computer's CD player, 
while another process has access to the CD player but is waiting for the printer. 
Another example occurs in systems in which processes are allowed to create new 
processes (an action called forking) to perform subtasks. If the scheduler has no 
space left in the process table and each process in the system must create an additional 
process before it can complete its task, then no process can continue. Such condi- 
tions, as in other settings (Figure 3.7), can severely degrade a system's performance. 

Analysis of deadlock has revealed that it cannot occur unless all three of the fol- 
lowing conditions are satisfied: 

1. There is competition for nonshareable resources. 

2. The resources are requested on a partial basis; that is, having received some 
resources, a process will return later to request more. 

3. Once a resource has been allocated, it cannot be forcibly retrieved. 

The point of isolating these conditions is that the deadlock problem can be removed 
by attacking any one of the three. In general, techniques that attack the third condi- 
tion tend to fall in the category known as deadlock detection and correction schemes. 
In these cases, the occurrence of deadlock is considered so remote that no effort is 
made to avoid the problem. Instead, the approach is to detect it should it occur and 
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Figure 3.7 A deadlock resulting from competition for nonshareable railroad intersections 



then correct it by forcibly retrieving some of the allocated resources. Our example of 
a full process table falls in this class. When initially setting up a computer system, the 
system administrator will usually establish a process table that is large enough for 
that particular installation. If, however, deadlock occurs because of a full table, the 
administrator merely uses his or her powers as "super user" to remove (the technical 
term is kill) some of the processes, which releases space in the process table so that 
the remaining processes can continue their tasks. 

Techniques that attack the first two conditions tend to be known as deadlock avoid- 
ance schemes. One, for example, attacks the second condition by requiring each process 
to request all its resources at one time. Another, perhaps more imaginative technique 
attacks the first condition, not by removing the competition directly but by converting 
nonshareable resources into shareable ones. For example, suppose the resource in 
question is a printer and a variety of processes require its use. Each time a process 
requests the printer, the operating system grants the request. However, instead of con- 
necting the process to the printer's device driver, the operating system connects it to 
a device driver that stores the information to be printed in mass storage rather than 
sending it to the printer. Thus each process, thinking it has access to the printer, exe- 
cutes in its normal way. Later, when the printer is available, the operating system can 
transfer the data from mass storage to the printer. In this manner, the operating sys- 
tem has made the nonshareable resource appear shareable by creating the illusion of 
more than one printer. This technique of holding data for output at a later but more 
convenient time is called spooling and is quite popular on systems of all sizes. 

We have introduced spooling as a technique for granting several processes access 
to a common resource-a theme that has many variations. For example, a file man- 
ager could grant several processes access to the same file if the processes are merely 
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reading data from the file, but conflicts can occur if more than one process tries to alter 
a file at the same time. Thus, a file manager may allocate file access according to the 
needs of the processes, allowing several processes to have read access but allowing 
only one to have write access. Other systems may divide the file into pieces so that 
different processes can alter different parts of the file concurrently. Each of these 
techniques, however, has subtleties that must be resolved to obtain a reliable system. 
How, for example, should those processes with only read access to a file be notified 
when a process with write access alters the file? 


1. Suppose process A and process B are sharing time on the same machine, 
a « d each needs the same nonshareable resource for short periods of time. 
(For example, each process may be printing a series of independent, short 
reports.) Each process may then repeatedly acquire the resource, release it, 
and later request it again. What is a drawback to controlling access to the 
resource in the following manner: 

Begin by assigning a flag the value 0. If process A requests the resource 
and the flag is 0, grant the request. Otherwise, make process A wait. If 
process B requests the resource and the flag is 1, grant the request. 
Otherwise, make process B wait. Each time process A finishes with the 
resource, change the flag to 1. Each time process B finishes with the 
resource, change the flag to 0. 

2 Suppose a two-lane road converges to one lane to pass through a tunnel. 

To coordinate the use of the tunnel, the following signal system has been 
installed: 

A car entering either end of the tunnel causes red lights above the tunnel 
entrances to be turned on. As the car exits the tunnel, the lights are 
turned off. If an approaching car finds a red light on, it waits until the 
light is turned off before entering the tunnel. 

What is the flaw in this system? 

3 Suppose the following solutions have been proposed for removing the dead- 
lock that occurs on a single-lane bridge when two cars meet. Identify which 
condition for deadlock given in the text is removed by each solution. 

a. Do not let a car onto the bridge until the bridge is empty. 

b. If cars meet, make one of them back up. 

c. Add a second lane to the bridge. 

4. Suppose we represent each process in a time-sharing system with a dot and 
draw an arrow from one dot to another if the process represented by the first 
dot is waiting for a resource being used by the second. Mathematicians call 
the resulting picture a directed graph. What property of the directed graph 
is equivalent to deadlock in the system? 


3.5 Security 


155 


3.5 Security 

Since the operating system oversees the activities in a computer, it is natural for it 
to play a vital role in maintaining security as well. In the broad sense, this respon- 
sibility manifests itself in multiple forms, one of which is reliability. If a flaw in the 
file manager causes the loss of part of a file, then the file was not secure. If a defect 
in the dispatcher leads to a system failure (often called a system crash) causing the 
loss of an hour's worth of typing, we would argue that our work was not secure. 
Thus the security of a computer system requires a well-designed, dependable oper- 
ating system. 

The development of reliable software is not a subject that is restricted to operat- 
ing systems. It permeates the entire software development spectrum and constitutes 
the field of computer science known as software engineering, which we will study in 
Chapter 7. In this section, then, we focus on security problems that are more closely 
related to the specifics of operating systems. 


Attacks from the Outside 

An important task performed by operating systems is to protect the computer's 
resources from access by unauthorized personnel. In the case of computers used by 
multiple people, this is usually approached by means of establishing "accounts" for the 
various authorized users-an account being essentially a record within the operating 
system containing such entries as the user's name, password, and privileges to be 
granted to that user. The operating system can then use this information during each 
login procedure (a sequence of transactions in which the user establishes initial con- 
tact with a computer's operating system) to control access to the system. 

Accounts are established by a person known as the super user or the adminis- 
trator. This person gains highly privileged access to the operating system by identi- 
fying himself or herself as the administrator (usually by name and password) during 
the login procedure. Once this contact is established, the administrator can alter set- 
tings within the operating system, modify critical software packages, adjust the priv- 
ileges granted to other users, and perform a variety of other maintenance activities 
that are denied normal users. 

From this "lofty perch," the administrator is also able to monitor activity within the 
computer system in an effort to detect destructive behavior, whether malicious or acci- 
dental. To assist in this regard, numerous software utilities, called auditing software, 
have been developed that record and then analyze the activities taking place within the 
computer system. In particular, auditing software may expose a flood of attempts to 
login using incorrect passwords, indicating that an unauthorized user may be trying to 
gain access to the computer. Auditing software may also identify activities within a 
user's account that do not conform to that user's past behavior, which may indicate that 
an unauthorized user has gained access to that account. (It is unlikely that a user who 
traditionally uses only word processing and spreadsheet software will suddenly begin 
to access highly technical software applications or try to execute utility packages that 
lie outside that user's privileges.) 
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Another culprit that auditing systems are designed to detect is the presence of 
sniffing software, which is software that, when left running on a computer, records 
activities and later reports them to a would-be intruder. An old, well-known example 
is a program that simulates the operating system's login procedure. Such a program 
can be used to trick authorized users into thinking they are communicating with the 
operating system, whereas they are actually supplying their names and passwords to 
an impostor. 

With all the technical complexities associated with computer security, it is sur- 
prising to many that one of the major obstacles to the security of computer systems 
is the carelessness of the users themselves. They select passwords that are rela- 
tively easy to guess (such as names and dates), they share their passwords with 
friends, they fail to change their passwords on a timely basis, they subject off-line 
mass storage devices to potential degradation by transferring them back and forth 
between machines, and they import unapproved software into the system that might 
subvert the system's security. For problems like these, most institutions with large 
computer installations adopt and enforce policies that catalog the requirements and 
responsibilities of the users. 


Attacks from Within 

Once an intruder (or perhaps an authorized user with malicious intent) gains access 
to a computer system, the next step is usually to explore, looking for information of 
interest or for places to insert destructive software. This is a straightforward process 
if the prowler has gained access to the administrator's account, which is why the 
administrator's password is closely guarded. If, however, access is through a general 
user's account, it becomes necessary to trick the operating system into allowing the 
intruder to reach beyond the privileges granted to that user. For example, the intruder 
may try to trick the memory manager into allowing a process to access main mem- 
ory cells outside its allotted area, or the prowler may try to trick the file manager into 
retrieving files whose access should be denied. 

Today's CPUs are enhanced with features that are designed to foil such attempts. 
As an example, consider the need to restrict a process to the area of main memory 
assigned to it by the memory manager. Without such restrictions, a process could 
erase the operating system from main memory and take control of the computer 
itself. To counter such attempts, CPUs designed for multitasking systems typically 
contain special-purpose registers in which the operating system can store the upper 
and lower limits of a process's allotted memory area. Then, while performing the 
process, the CPU compares each memory reference to these registers to ensure that 
the reference is within the designated limits. If the reference is found to be outside 
the process's designated area, the CPU automatically transfers control back to the 
operating system (by performing an interrupt sequence) so that the operating sys- 
tem can take appropriate action. 

Embedded in this illustration is a subtle but significant problem. Without further 
security features, a process could still gain access to memory cells outside of its des- 
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ignated area merely by changing the special-purpose registers that contain its mem- 
ory limits. That is, a process that wanted access to additional memory could merely 
increase the value in the register containing the upper memory limit and then pro- 
ceed to use the additional memory space without approval from the operating system. 

To protect against such actions, CPUs for multitasking systems are designed to 
operate in one of two privilege levels; we will call one "privileged mode," the other 
we will call "nonprivileged mode." When in privileged mode, the CPU is able to exe- 
cute all the instructions in its machine language. However, when in nonprivileged 
mode, the list of acceptable instructions is limited. The instructions that are available 
only in privileged mode are called privileged instructions. (Typical examples of 
privileged instructions include instructions that change the contents of memory limit 
registers and instructions that change the current privilege mode of the CPU.) An 
attempt to execute a privileged instruction when the CPU is in nonprivileged mode 
causes an interrupt. This interrupt converts the CPU to privileged mode and transfers 
control to an interrupt handler within the operating system. 

When first turned on, the CPU is in privileged mode. Thus, when the operating 
system starts at the end of the boot process, all instructions are executable. However, 
each time the operating system allows a process to start a time slice, it switches the 
CPU to nonprivileged mode by executing a "change privilege mode" instruction. In 
turn, the operating system will be notified if the process attempts to execute a privi- 
leged instruction, and thus the operating system will be in position to maintain the 
integrity of the computer system. 

Privileged instructions and the control of privilege levels is the major tool avail- 
able to operating systems for maintaining security. However, the use of these tools is 
a complex component of an operating system's design, and errors continue to be 
found in current systems. A single flaw in privilege level control can open the door 
to disaster from malicious programmers or from inadvertent programming errors. If 
a process is allowed to alter the timer that controls the system's time-sharing, that 
process can extend its time slice and dominate the machine. If a process is allowed 
to access peripheral devices directly, then it can read files without supervision by the 
system's file manager. If a process is allowed to access memory cells outside its allot- 
ted area, it can read and even alter data being used by other processes. Thus, main- 
taining security continues to be an important task of an administrator as well as a 
goal in operating system design. 


1 Give some examples of poor choices for passwords and explain why they 
would be poor choices. 

2. Processors in Intel's Pentium series use four privilege levels. Why would the 
designers decide to have four levels rather than three or five? 

3. If a process in a time-sharing system could access memory cells outside its 
allotted area, how could it gain control of the machine? 


Questions 
& Exercises 
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Chapter Review Problems 

(Asterisked problems are associated with optional sections.) 


1. List four activities of a typical operating 
system. 

2. Summarize the distinction between batch pro- 
cessing and interactive processing. 

3. Suppose three items R, S, and T are placed in 
a queue in that order. Then two items are 
removed from the queue before a fourth item, 
X, is placed in the queue. Then two items are 
removed from the queue, the items Y and Z 
are placed in the queue, and then the queue is 
emptied by removing one item at a time. List 
all the items in the order in which they were 
removed. 

4. What is the difference between interactive 
processing and real-time processing? 

5. What is a multitasking operating system? 

6. If you have a PC, identify some situations in 
which you can take advantage of its multi- 
tasking capabilities. 

7. On the basis of a computer system with 
which you are familiar, identify two units of 
application software and two units of utility 
software. Then explain why you classified 
them as you did. 

6. What directory structure is described by the 
path X/Y/Z? 

9. What information is contained in a process 
table within an operating system? 

1 0. What is the difference between a process that 
is ready and a process that is waiting? 

1 1 . What is the difference between virtual mem- 
ory and main memory? 

1 2. Suppose a computer contained 512MB (MiB) 
of main memory, and an operating system 
needed to create a virtual memory of twice 
that size using pages of 2KB (KiB). How many 
pages would be required? 


13. What complications could arise in a time- 
sharing system if two processes require access 
to the same file at the same time? Are there 
cases in which the file manager should grant 
such requests? Are there cases in which the 
file manager should deny such requests? 

14. Define load balancing and scaling in the con- 
text of multiprocessor architectures. 

15. Summarize the booting process. 

1 6. If you have a PC, record the sequence activi- 
ties that you can observe when you turn it 
on. Then determine what messages appear 
on the computer screen before the booting 
process actually begins. What software writes 
these messages? 

1 7. Suppose a time-sharing operating system allo- 
cated time slices of 20 milliseconds and the 
machine executed an average of 5 instructions 
per microsecond. How many instructions 
could be executed in a single time slice? 

18. If a typist types 60 words per minute (where a 
word is considered five characters), how much 
time would pass between typing each charac- 
ter? If a time-sharing operating system allo- 
cated time slices in 20 millisecond units and 
we ignore the time required for process 
switches, how many time-slices could be allo- 
cated between characters being typed? 

19. Suppose a time-sharing operating system is 
allotting time slices of 50 milliseconds. If it 
normally takes 8 milliseconds to position a 
disk's read/write head over the desired track 
and another 17 milliseconds for the desired 
data to rotate around to the read/write head, 
how much of a program's time slice can be 
spent waiting for a read operation from a disk 
to take place? If the machine is capable of exe- 
cuting ten instructions each microsecond, how 
many instructions can be executed during this 
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waiting period? (This is why when a process 
performs an operation with a peripheral 
device, a time-sharing system terminates that 
process's time slice and allows another process 
to run while the first process is waiting for the 
services of the peripheral device.) 

20 . List five resources to which a multitasking 
operating system might have to coordinate 
access. 

2 1 A process is said to be I/O-bound if it requires 
a lot of I/O operations, whereas a process that 
consists of mostly computations within the 
CPU/memory system is said to be compute- 
bound. Ifboth a compute-bound process and 
an I/O-bound process are waiting for a time 
slice, which should be given priority? Why? 

22 Would greater throughput be achieved by a 
system running two processes in a time- 
sharing environment ifboth processes were 
I/O-bound (refer to Problem 21) or if one was 
I/O-bound and the other was compute-bound? 
Why? 

23 . Write a set of directions that tells an operating 

system's dispatcher what to do when a 
process's time slice is over. 

24. Identify the components of the state of a 
process. 

26 . Identify a situation in a time-sharing system 
in which a process does not consume the 
entire time slice allocated to it. 

26 . List in chronological order the major events 
that take place when a process is interrupted. 

2 7 . Answer each of the following in terms of an 
operating system that you use: 

a. How do you ask the operating system to 
copy a file from one location to another? 

b. How do you ask the operating system to 
show you the directory on a disk? 

c. How do you ask the operating system to 
execute a program? 

28. Answer each of the following in terms of an 
operating system that you use: 


a. How does the operating system restrict 
access to only those who are approved users? 

b. How do you ask the operating system to 
show you what processes are currently in 
the process table? 

c. How do you tell the operating system that 
you do not want other users of the machine 
to have access to your files? 

29 . Explain an important use for the test-and-set 
instruction found in many machine lan- 
guages. Why is it important for the entire test- 
and-set process to be implemented as a single 
instruction? 

3 0, A banker with only $100,000 loans $50,000 to 
each of two customers. Later, both customers 
return with the story that before they can 
repay their loans they must each borrow 
another $10,000 to complete the business 
deals in which their previous loans are 
involved. The banker resolves this deadlock 
by borrowing the additional funds from 
another source and passing on this loan (with 
an increase in the interest rate) to the two cus- 
tomers. Which of the three conditions for 
deadlock has the banker removed? 

3 1 Students who want to enroll in Model 
Railroading II at the local university are 
required to obtain permission from the 
instructor and pay a laboratory fee. The two 
requirements are fulfilled independently in 
either order and at different locations on cam- 
pus. Enrollment is limited to 20 students; this 
limit is maintained by both the instructor, who 
will grant permission to only 20 students, and 
the financial office, which will allow only 20 
students to pay the laboratory fee. Suppose 
that this registration system has resulted in 1 9 
students having successfully registered for the 
course, but with the final space being claimed 
by 2 students-one who has only obtained per- 
mission from the instructor and another who 
has only paid the fee. Which requirement for 
deadlock is removed by each of the following 
solutions to the problem: 
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a. Both students are allowed in the course, 

b. The class size is reduced to 19, so neither of 
the two students is allowed to register for 
the course. 

c. The competing students are both denied 
entry to the class and a third student is 
given the twentieth space. 

d. It is decided that the only requirement for 
entry into the course is the payment of the 
fee. Thus the student who has paid the fee 
gets into the course, and entry is denied to 
the other student. 

*32. Since each area on a computer's monitor 

screen can be used by only one process at a 
time (otherwise the image on the screen 
would be unreadable), these areas are non- 
shareable resources that are allocated by the 
window manager. Which of the three condi- 
tions necessary for deadlock does the window 
manage] remove in order to avoid deadlock? 

*33. Suppose each nonshareable resource in a com- 
puter system is classified as a level 1, level 2, 
or level 3 resource. Moreover, suppose each 
process in the system is required to request 
the resources it needs according to this classi- 
fication. That is, it must request all the 
required level 1 resources at once before 
requesting any level 2 resources. Once it 
receives the level 1 resources, it can request 
all the required level 2 resources, and so on. 
Can deadlock occur in such a system? Why 
or why not? 

*34. Each of two robot arms is programmed to lift 
assemblies from a conveyor belt, test them for 
tolerances, and place them in one of two bins 
depending on the results of the test. The 
assemblies arrive one at a time with a suffi- 
cient interval between them. To keep both 
arms from trying to grab the same assembly, 
the computers controlling the arms share a 
common memory cell. If an arm is available 
as an assembly approaches, its controlling 
computer reads the value of the common cell. 
If the value is nonzero, the arm lets the 


assembly pass. Otherwise, the controlling 
computer places a nonzero value in the mem- 
ory cell, directs the arm to pick up the assem- 
bly, and places the value 0 back into the 
memory cell after the action is complete. 

What sequence of events could lead to a tug- 
of-war between the two arms? 

*35. Identify the use of a queue in the process of 
spooling output to a printer. 

*36. A process that is waiting for a time slice is said 
to suffer starvation if it is never given a time 
slice. 

a. The pavement in the middle of an intersec- 
tion can be considered as a nonshareable 
resource for which cars approaching the 
intersection compete. A traffic light rather 
than an operating system is used to control 
the allocation of the resource. If the light is 
able to sense the amount of traffic arriving 
from each direction and is programmed to 
give the green light to the heavier traffic, 
the lighter traffic might suffer from starva- 
tion. How is starvation avoided? 

b. In what sense can a process starve if the dis- 
patcher always assigns time slices according 
to a priority system in which the priority of 
each process remains fixed? (Hint What is 
the priority of the process that just com- 
pleted its time slice in comparison to the 
processes that are waiting, and conse- 
quently which routine gets the next time 
slice?) How, would you guess, do many 
operating systems avoid this problem? 

•37 What is the similarity between deadlock and 
starvation? (Refer to Problem 36.) What is the 
difference between deadlock and starvation? 

•38 The following is the "dining philosophers" 

problem that was originally proposed by E. W. 
Dijkstra and is now a part of computer science 
folklore. 

Five philosophers are sitting at a round table. 
In front of each is a plate of spaghetti. There 
are five forks on the table, one between each 
plate. Each philosopher wants to alternate 
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between thinking and eating. To eat, a philoso- 
pher requires possession of both the forks that 
are adjacent to the philosopher’s plate. 

Identify the possibilities of deadlock and star- 
vation (see Problem 36) that are present in the 
dining philosophers problem. 

•39, What problem arises as the lengths of the time 
slices in a time-sharing system are made 
shorter and shorter? What about as they 
become longer and longer? 

-40 As computer science has developed, machine 
languages have been extended to provide spe- 
cialized instructions. Three such machine 
instructions were introduced in Section 3.4 
that are used extensively by operating sys- 
tems. What are these instructions? 

41. How does an operating system keep a process 
from accessing another process's memory 
space? 


42. Suppose a password consisted of a string of 
nine characters from the English alphabet (26 
characters). If each possible password could be 
tested in a millisecond, how long would it take 
to test all possible passwords? 

43. Why are CPUs that are designed for multi- 
tasking operating systems capable of operating 
at different privilege levels? 

44. Identify two activities that are typically 
requested by privileged instructions. 

45. Identify three ways in which a process could 
challenge the security of a computer system if 
not prevented from doing so by the operating 
system. 


Social Issues 


The following questions are intended as a guide to the ethical/social/legal issues asso- 
ciated with the field of computing. The goal is not merely to answer these questions. 
You should also consider why you answered as you did and whether your justifications 
are consistent from one question to the next. 

1. Suppose you are using a multiuser operating system that allows you to view 
the names of the files belonging to other users as well as to view the contents 
of those files that are not otherwise protected. Would viewing such informa- 
tion without permission be similar to wandering through someone's unlocked 
home without permission, or would it be more like reading materials placed 
in a common lounge such as a physician's waiting room? 

2. When you have access to a multiuser computer system, what responsibilities 
do you have when selecting your password? 

3. If a flaw in an operating system's security allows a malicious programmer to 
gain unauthorized access to sensitive data, to what extent should the devel- 
oper of the operating system be held responsible? 

4. Is it your responsibility to lock your house in such a way that intruders can- 
not get in, or is it the public's responsibility to stay out of your house unless 
invited? Is it the responsibility of an operating system to guard access to a 


162 


Operating Systems 


computer and its contents, or is it the responsibility of hackers to leave the 
machine alone? 

5 . In Walden, Henry David Thoreau argues that we have become tools of our 
tools; that is, instead of benefiting from the tools that we have, we spend our 
time obtaining and maintaining our tools. To what extent is this true with 
regard to computing? For example, if you own a personal computer, how much 
time do you spend earning the money to pay for it, learning how to use its 
operating system, learning how to use its utility and application software, 
maintaining it, and downloading upgrades to its software in comparison to the 
amount of time you spend benefiting from it? When you use it, is your time 
well spent? Are you more socially active with or without a personal computer? 
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In this chapter we discuss the area of 
computer science known as networking, 
which encompasses the study ofhow 
computers can be linked together to share 
information and resources. Our study will 
include the construction and operation of 
networks, applications of networks, and 
security issues. A prominent topic will be 
a particular worldwide network of net- 
works known as the Internet. 
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The need to share information and resources among different computers has led to 
linked computer systems, called networks, in which computers are connected so 
that data can be transferred from machine to machine. In these networks, computer 
users can exchange messages and share resources-such as printing capabilities, soft- 
ware packages, and data storage facilities-that are scattered throughout the system. 
The underlying software required to support such applications has grown from sim- 
ple utility packages into an expanding system of network software that provides a 
sophisticated network wide infrastructure. In a sense, network software is evolving into 
a network wide operating system. In this chapter we will explore this expanding field 
of computer science. 


4.1 Network Fundamentals 

We begin our study of networks by introducing a variety of basic networking concepts. 


Network Classifications 

A computer network is often classified as being either a local area network (LAN), 
a metropolitan area network (MAN), or a wide area network (WAN). A LAN 
normally consists of a collection of computers in a single building or building complex. 
For example, the computers on a university campus or those in a manufacturing plant 
might be connected by a LAN. A MAN is a network of intermediate size, such as one 
spanning a local community. A WAN links machines over a greater distance-perhaps 
in neighboring cities or on opposite sides of the world. 

Another means of classifying networks is based on whether the network's inter- 
nal operation is based on designs that are in the public domain or on innovations 
owned and controlled by a particular entity such as an individual or a corporation. A 
network of the former type is called an open network; a network of the latter type is 
called a closed, or sometimes a proprietary, network. 

The Internet (a popular worldwide network of networks that we will study shortly) 
is an open system. In particular, communication throughout the Internet is governed 
by an open collection of standards known as the TCP/IP protocol suite, which we will 
discuss in Section 4.4. Anyone is free to use these standards without paying fees or 
signing license agreements. In contrast, a company such as Novell Inc. might develop 
systems for which it chooses to maintain ownership rights, allowing the company to 
draw income from selling or leasing these products. Networks based on such systems 
are examples of closed networks. 

Still another way of classifying networks is based on the topology of the network, 
which refers to the pattern in which the machines are connected. Figure 4.1 represents 
three popular topologies: (1) ring, in which the machines are connected in a circular 
fashion; (2) bus, in which the machines are all connected to a common communica- 
tion line called a bus; and (3) star, in which one machine serves as a central focal 
point to which all the others are connected. Of these, the star network is perhaps the 
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Figure 4.1 Network topologies 





oldest, having evolved from the paradigm of a large central computer serving many 
users. As the simple terminals employed by these users grew into small computers 
themselves, a star network emerged. Today, however, the bus topology, having been 
popularized under the standards known as Ethernet, is probably the most popular net- 
work topology. 

It is important to remember that a network's topology might not be obvious from 
its physical appearance. For instance, a bus network might not appear as a long bus 
from which computers are connected over short links as depicted in Figure 4.1. 
Instead, it is common to construct a bus network by running links from each computer 
to a central location where they are connected to a device called a huh. This hub is 
little more than a very short bus. All it does is relay any signal it receives (with per- 
haps some amplification) back out to all the machines connected to it. The result is 
a network that looks like a star network although it operates like a bus network. The 
difference is that the central device in a star network is a computer (often one with 
more capacity than those at the points of the star) that receives and often processes 
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messages from the other computers. In contrast, the central device in the bus network 
is a hub that merely provides a common communication path to all the computers. 

Another point to emphasize is that the connections between machines in a net- 
work do not need to be physical. Wireless networks, using radio broadcast technology, 
are becoming quite common. In particular, the hub in many of today's bus networks 
is essentially a radio relay station. 


Protocols 


For a network to function reliably, it is important to establish rules by which net- 
work activities are conducted. Such rules are called protocols. By developing and 
adopting protocol standards, vendors are able to build products for network appli- 
cations that are compatible with products from other vendors. Thus, the develop- 
ment of protocol standards is an indispensable process in the development of 
networking technologies. 

As an introduction to the protocol concept, let us consider the problem of coor- 
dinating the transmission of messages among computers in a network. Without 
rules governing this communication, all the computers might insist on transmit- 
ting messages at the same time or might fail to relay messages when that assistance 
is required. 

One approach to solving this problem is the token ring protocol, which was 
developed by IBM in the 1970s and continues to be a popular protocol in networks 
based on the ring topology. In this protocol, all the machines in the network trans- 
mit messages in only one common direction (Figure 4.2), meaning that all messages 
sent over the network move around the ring in the same direction by being for- 
warded from computer to computer. When a message reaches its destination, the 
destination machine keeps a copy of it and forwards a copy on around the ring. When 


Figure 4.2 Communication over a ring network 
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the forwarded copy reaches the originating computer, that machine knows that the 
message must have reached its destination and removes the message from the ring. 
Of course, this system depends on inter-machine cooperation. If a machine insists 
on constantly transmitting messages of its own rather than forwarding those of the 
other machines, nothing will be accomplished. 

To solve this problem, a unique bit pattern, called a token, is passed around the 
ring. Possession of this token gives a machine the authority to transmit its own mes- 
sage; without the token, a machine is only allowed to forward messages. Normally, 
each machine merely relays the token in the same manner in which it relays mes- 
sages. If, however, the machine receiving the token has messages of its own to intro- 
duce to the network, it transmits one message while holding the token. When this 
message has completed its cycle around the ring, the machine forwards the token to 
the next machine in the ring. Likewise, when the next machine receives the token, 
it can either forward the token immediately or transmit its own new message before 
sending the token on to the next machine. In this manner, each machine in the net- 
work has equal opportunity to introduce messages of its own as the token circles 
around the ring. 

Another protocol for coordinating message transmission is used in bus topology 
networks that are based on the Ethernet protocol collection. In an Ethernet system, 
the right to transmit messages is controlled by the protocol known as Carrier Sense, 
Multiple Access with Collision Detection (CSMA/CD). This protocol dictates that 
each message be broadcast to all the machines on the bus (Figure 4.3). Each machine 
monitors all the messages but keeps only those addressed to itself. To transmit a mes- 
sage, a machine waits until the bus is silent, and at this time it begins transmitting 
while continuing to monitor the bus. If another machine also begins transmitting, 
both machines detect the clash and pause for abrief random period of time before try- 
ing to transmit again. The result is a system similar to that used by a small group of 
people in a conversation. If two people start to talk at once, they both stop. The dif- 
ference is that people might go through a series such as, "I'm sorry, what were you 
going to say?", "No, no. You go first," whereas under the CSMA/CD protocol each 
machine merely tries again. 


Figure 4.3 Communication over a ous network 
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Combining Networks 

Sometimes it is necessary to connect existing networks to form an extended com- 
munication system. This can be done by connecting the networks to form a larger ver- 
sion of the same "type" of network. For example, in the case of bus networks based 
on the Ethernet protocols, it is often possible to connect the buses to form a single large 
bus. This is done by means of different devices known as repeaters, bridges, and 
switches, the distinctions of which are subtle yet informative. The simplest of these 
is the repeater, which is little more than a device that connects two buses to form a 
single long bus (Figure 4.4a). The repeater simply passes signals back and forth 
between the two original buses (usually with some form of amplification) without 
considering the meaning of the signals. 

Abridge is similar to, but more complex than, a repeater. Like a repeater, it con- 
nects two buses, but it does not necessarily pass all messages across the connection. 
Instead, it looks at the destination address that accompanies each message and for- 
wards a message across the connection only when that message is destined for a com- 
puter on the other side. Thus, two machines residing on the same side of a bridge can 
exchange messages without interfering with communication taking place on the other 
side. Abridge produces a more efficient system than that produced by a repeater. 

A switch is essentially a bridge with multiple connections, allowing it to connect 
several buses rather than just two. Thus, a switch produces a network consisting of sev- 
eral buses extending from the switch as spokes on a wheel (Figure 4.4b). As in the case 
of a bridge, a switch considers the destination addresses of all messages and forwards only 


Figure 4.4 Building a large bus network from smoiler ones 
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those messages destined for other spokes. Moreover, each message that is forwarded is 
relayed only into the appropriate spoke, thus minimizing the traffic in each spoke. 

It is important to note that when networks are connected via repeaters, bridges, 
and switches, the result is a single large network. Each computer continues to com- 
municate over the system in the same manner (using the same protocols) that it 
would if the system had been constructed originally as a single large network. That 
is, the existence of repeaters, bridges, and switches is transparent to the individual 
computers in the system. 

Sometimes, however, the networks to be connected have incompatible charac- 
teristics. For instance, the characteristics of a ring network using the token ring pro- 
tocol arc not readily compatible with an Ethernet bus network using CSMA/CD. In 
these cases the networks must be connected in a manner that builds a network of 
networks, known as an internet, in which the original networks maintain their indi- 
viduality and continue to function as independent networks. (Note that the generic 
term internet is distinct from the Internet. The Internet, written with an upper case I, 
refers to a particular, worldwide internet that we will study in other sections of this 
chapter. There are many other examples of internets. Indeed, traditional telephone 
communication was handled by worldwide internet systems well before the Internet 
was popularized.) 

The connection between two networks to form an internet is handled by a 
machine known as a router. A router is a computer belonging to both networks that 
forwards messages in one network into the other network (Figure 4.5). Note that the 
task of a router is significantly greater than that of repeaters, bridges, and switches 
because a router must convert between the idiosyncrasies of the two original net- 
works. For example, when transferring a message from a network using the token 
ring protocol to a network using CSMA/CD, a router must receive the message using 
one protocol and then transmit it to the other network using another protocol. 

As another example of the complexities resolved by a router, consider the prob- 
lem posed when the two networks being connected use different addressing systems 
to identify the computers in the networks. When a computer in one network wants 
to send a message to a computer in the other, it cannot identify the destination com- 
puter in the manner to which it is accustomed. 

Figure 4.5 A router connecting a bus network with a star network to form an internet 
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Ethernet 

Ethernet is a set of standards for implementing a LAN with a bus topology. Its 
name is derived from the original Ethernet design in which machines were con- 
nected by a coaxial cable called the ether. Originally developed in the 1970s and 
now standardized by IEEE as a part of the IEEE 802 family of standards, Ethernet 
is the most common method of networking PCs. Indeed, Ethernet controller 
cards for PCs are readily available and easily installed. 

Today there are actually several versions of Ethernet, reflecting advances in 
technology and higher transfer rates. All, however, share common traits that char- 
acterize the Ethernet family. Among these are the format in which data are pack- 
aged for transmission, the use of Manchester encoding (a method of representing 
Os and Is in which a 0 is represented by a descending signal and a 1 is represented 
by an ascending signal) for the actual transmission of bits, and the use of 
CSMA/CD for controlling the light to transmit. 


In such cases a new internet-wide addressing system is established. The result 
is that each machine in an internet has two addresses: its original network address 
and its new internet address. To send a message from a computer in one of the orig- 
inal networks to a computer in the other, the computer at the origin bundles the 
destination's internet addresses with the message, and sends the bundle to the router 
using the local network's original addressing system. The router then looks inside 
the bundle, finds the internet address of the message's ultimate destination, trans- 
lates that address into the address format that is appropriate for the other network, 
and forwards the message to its destination. In short, messages within each of the 
original networks continue to be transferred by means of each network's original 
addressing system, and the router is charged with the task of converting between 
the systems. 

Interprocess Communication 

The various activities (or processes) executing on the different computers within a net- 
work (or even executing on the same machine via time sharing) must often commu- 
nicate with each other to coordinate their actions and to perform their designated tasks. 
Such communication between processes is called interprocess communication. 

A popular convention used for interprocess communication is the client/server 
model. This model defines the basic roles played by the processes as either a client, 
which makes requests of other processes, or a server, which satisfies the requests 
made by clients. 

An early application of the client/server model appeared in networks connect- 
ing all the computers in a cluster of offices. In this situation, a single, high-quality 
printer was attached to the network where it was available to all the machines in the 
network. In this case the printer played the role of a server (often called a print 
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server), and the other machines were programmed to play the role of clients that 
sent print requests to the print server. 

Another early application of the client/server model was used to reduce the cost 
of disk storage while also removing the need for duplicate copies of records. Here 
one machine in a network was equipped with a high-capacity mass storage system 
(usually a magnetic disk) that contained all of an organization's records. Other 
machines on the network then requested access to the records as they needed them. 
Thus the machine that actually contained the records played the role of a server 
(called a file server), and the other machines played the role of clients that requested 
access to the files that were stored at the file server. 

Today the client/server model is used extensively in network applications, as we 
will see later in this chapter. However, the client/server model is not the only means 
of interprocess communication. Another model is the peer-to-peer (often abbreviated 
P2P) model, whose properties provide insightful contrasts to the client/server model. 
Whereas the client/server model involves one process (the server) communicating 
with numerous others (clients), the peer-to-peer model involves two processes com- 
municating as equals (Figure 4.6). Moreover, whereas a server must execute contin- 
uously so that it is prepared to serve its clients at any time, the peer-to-peer model 
usually involves two processes that execute on a temporary basis. For example, appli- 
cations of the peer-to-peer model include instant messaging in which two people carry 


Figure 4.6 The client/server model compared to the peer-to-peer model 
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on a written conversation over the Internet as well as situations in which people play 
games such as chess or checkers. 

The peer-to-peer model is also a popular means of sharing files such as music 
recordings and motion pictures via the Internet (sometimes with questionable legal- 
ity). In this case, individuals who are seeking particular items broadcast their desire 
over the Internet and are contacted by those who own the items of interest. Then, the 
items are transferred between the two parties using the peer-to-peer model. This is 
in contrast to earlier approaches that applied the client/server model by establishing 
a central "distribution center" (the server) from which clients downloaded music 
recordings (or at least found sources for those items). The central server, however, 
proved to be a focal point at which the music industry could enforce copyright laws, 
leading to the eventual dismantling of these music distribution centers. In contrast, 
the lack of a centralized base of operation obtained via the peer-to-peer model makes 
legal efforts to enforce copyright laws more difficult. 

You might often read or hear the term peer-to-peer network, which is an example of 
how misuse of terminology can evolve when technical terms are adopted by the non- 
technical community. The term peer-to-peer refers to a system by which two processes 
communicate over a network (or internet). It is not a property of the network (or inter- 
net). A process might use the peer-to-peer model to communicate with another process 
and later use the client/server model to communicate with another process over the 
same network. Thus, it would be more accurate to speak of communicating by means 
of the peer-to-peer model rather than communicating over a peer-to-peer network. 


Distributed Systems 

With the success of networking technology, interaction between computers via net- 
works has become common and multifaceted. Many modern software systems, such 
as global information retrieval systems, company-wide accounting and inventory sys- 
tems, computer games, and even the software that controls a network's infrastruc- 
ture itself are designed as distributed systems, meaning that they consist of software 
units that execute as processes on different computers. We can envision these 
processes as guests at the various machines in which they reside-an analogy that 
leads to the computers in a network being called hosts. That is, a host is a computer 
at which processes reside or, in a more dynamic context, might take up residence. 

Early distributed systems were developed independently from scratch. But today, 
research is revealing a common infrastructure running throughout these systems, 
including such things as communication and security systems. In turn, efforts have 
been made to produce prefabricated systems that provide this basic infrastructure 
and therefore allow distributed applications to be constructed by merely developing 
the part of the system that is unique to the application. 

One result of such undertakings is the system known as Enterprise JavaBeans 
(developed by Sun Microsystems), which is a development environment that aids in 
the construction of new distributed software systems. Using Enterprise JavaBeans, a 
distributed system is constructed from units called beans that automatically inherit 
the enterprise infrastructure. Thus, only the unique application-dependent portions 
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of a new system must be developed. Another approach is the software development 
environment called .NET Framework (developed by Microsoft). In the .NET termi- 
nology the components of a distributed system are called assemblies. Again, by devel- 
oping these units in the .NET environment, only the characteristics that are unique 
to the particular application need to be constructed- the infrastructure is prefabri- 
cated. Both Enterprise JavaBeans and the .NET Framework have greatly simplified the 
task of developing new distributed software systems. 


1. What is an netW0fk? 

2 Summarize the distinction between a repeater and a bridge. 

3 What is a router? 

4 Identify some relationships in society that conform to the client/server model. 
5. Identify some protocols used in society. 
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4.2 The Internet 

The most notable example of an internet is the Internet (note the uppercase I), which 
originated from research projects going back to the early 1960s. The goal was to 
develop the ability to link a variety of computer networks so that they could function 
as a connected system that would not be disrupted by local disasters. Most of this 
original work was sponsored by the U.S. government through the Defense Advanced 
Research Projects Agency (DARFA — pronounced "DAR-pa"). Over the years, the devel- 
opment of the Internet shifted from a defense project to an academic research proj- 
ect, and today it is largely a commercial undertaking that links a worldwide 
combination of WANs, MANs, and LANs involving millions of computers. 


Internet Architecture 

Conceptually, the Internet can be viewed as a collection of domains, each of which 
consists of a network or a relatively small internet operated by a single organization 
such as a university, company, or government agency. Each domain is an 
autonomous system that can be configured as the local authority desires. It might con- 
sist of a single computer or a complex internet consisting of many LANs, MANs, and 
even WANs. 

The establishment of domains is overseen by the Internet Corporation for 
Assigned Names and Numbers (ICANN), which is a nonprofit corporation estab- 
lished to coordinate the naming of domains and the assignment of Internet addresses, 
as we will learn shortly. To establish a domain on the Internet, the domain must first 
be registered via one of the companies, called registrars, that have been delegated for 
this purpose by ICANN. 
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Internet 

Now that the Internet has shifted from a research project to a household com- 
modity, the research community has moved on to a project called Internet2. 
Internet2 is intended as an academic-only system and involves numerous uni- 
versities working in partnership with industry and government. The goal is to 
conduct research in internet applications requiring high bandwidth communi- 
cation, such as remote access and control of costly state-of-the-art equipment 
such as telescopes and medical diagnostic devices. An example of current 
research involves remote surgery performed by robot hands that mimic the 
hands of a distant surgeon who views the patient by video. You can learn more 
about Internet2 at http: //www. internet2 .org. 


Once a domain has been registered, it can be attached to the existing Internet by 
means of a router that connects one of the networks in the domain to a network 
already in the Internet. This particular router is often referred to as the domain's 
gateway, in that it represents the domain's gate to the rest of the Internet. From the 
point of view of a single domain, the portion of the Internet lying outside of its gate- 
way is sometimes called the cloud, in reference to the fact that the structure of the 
Internet outside the domain's gateway is out of the domain's control and is of mini- 
mal concern to the operation of the domain itself. Any message being transmitted to 
a destination within the domain is handled within the domain; any message being 
transmitted to a destination outside the domain is directed toward the gateway where 
it is sent out into the cloud. 

If one "stood" at a domain's gateway and "looked out" into the cloud, one could find 
a variety of structures. Indeed, the Internet has grown in a somewhat haphazard way 
as various domains have found points at which to connect to the cloud. One popular 
structure, however, is foT the gateways of a number of domains to be connected to 
form a regional network of gateways. For instance, a group of universities could choose 
to pool their resources to construct such a network. In turn, this regional network 
would be connected to a more global network to which other regional networks attach. 
In this manner, that portion of the cloud takes on a hierarchical structure (Figure 4.7). 

Connecting to the Internet 

To simplify the process of connecting to the Internet, numerous companies, called 
Internet sendee providers (ISP), allow customers to connect their domains to the 
Internet via the ISP's equipment or to become a part of a domain already established 
by the ISP. Perhaps the least expensive connections to an ISP are obtained through tem- 
porary telephone links called dial-up connections. Using this approach, an individual 
connects his or her computer to the local telephone line and executes a software pack- 
age that places a call to a computer at the ISP. At this point the ISP provides Internet 
access for the duration of the telephone call. 
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Figure 4.7 Atypical approach to connecting to the Internet 
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This temporary connection model is popular (and, in fact, expanding) in the cell 
phone/hand-held computer arena. However, in fixed location applications it is rapidly 
giving way to permanent connections through higher bandwidth systems such as 
DSL, cable television lines, and satellite links. These technologies have greatly reduced 
the expense of broadband (high-capacity) Internet access (which used to be available 
only to large organizations that could afford the expense of dedicated Internet con- 
nections), making today’s multimedia applications accessible to home users. 

Another development taking place at the household level is that home computer 
systems are expanding from single computer installations to multicomputer networks, 
usually implemented as Ethernet bus networks. These networks gain access to the 
Internet by means of a router within the home that is permanently connected to an 
ISP via DSL, a cable television line, or a satellite link, making the home system a local 
network within a domain established by the ISP. The connection from the home's 
router to the local computers is often wireless. That is, each computer communicates 
with the router by means of a small transmitter/receiver with a range of approxi- 
mately 100 feet. Such wireless local networks are popular outside the home as well 
where they are used to create hotspots in which any wireless-enabled computer (lap- 
top or hand held) that comes within range can access the Internet. Examples include 
office buildings, "cyber cafes," public plazas, and entire cities. 

In closing we should note that ISPs provide much more than mere access to the 
Internet. In many cases they are the companies that construct and maintain the Inter- 
net infrastructure. Moreover, their services generally include a wide array of both 
hardware and software support for their customers. In fact, an ISP might provide a sig- 
nificant portion of the computing resources (such as data storage and data processing 
services) required by a client. 
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Internet Addressing 

As we learned in Section 4.1, an internet must be associated with an internet-wide 
addressing system that assigns an identifying address to each computer in the system. 
In the Internet these addresses are known as IP addresses. (The term IP refers to 
"Internet Protocol," which is a term we will learn more about in Section 4.4.) Each IP 
address is a pattern of 32 bits, although plans are currently underway to increase this 
to 128 bits (see the discussion of IPv6 in Section 4.4). Each 32-bit address consists of two 
parts: a pattern identifying the domain in which the computer resides and a pattern iden- 
tifying the particular computer within the domain. The part of the address identifying 
the domain, the network identifier, is assigned under the authority of ICANN at the 
rime the domain is registered. Thus it is by means of this registration process that each 
domain in the Internet is assured of having a unique network identifier. The portion of 
the address that identifies a particular computer within a domain is called the host 
address. The host address is assigned by the domain's local authority-usually a per- 
son having a job title such as network administrator or system administrator. 

IP addresses are traditionally written in dotted decimal notation in which the 
bytes of the address are separated by periods and each byte is expressed as an integer 
represented in traditional base ten notation. For example, using dotted decimal notation, 
the pattern 5.2 would represent the two-byte bit pattern 0000010100000010, which con- 
sists of the byte 00000101 (represented by 5) followed by the byte 00000010 (represented 
by 2), and the pattern 17.12.25 would represent the three-byte bit pattern consisting of 
the byte 00010001 (which is 17 written in binary notation), followed by the byte 00001100 
(12 written in binary) , followed by the byte 0001 1001 (25 written in binary) . Thus a com- 
puter in the domain of the Addison-Wesley publishing company might have the IP 
address 192.207.177.133, where the first three bytes (192.207.177) form the network 
identifier (identifying the Addison-Wesley domain) and the last byte (133) is the host 
address (identifying a particular computer within Addison-Wesley's domain). 

Addresses in bit-pattern form (even when compressed using dotted decimal nota- 
tion) are rarely conducive to human consumption. For this reason each domain is 
also assigned a unique mnemonic address known as a domain name. For example, 
the domain name of the Addison-Wesley publishing company is aw. com. Note that 
the naming system reflects the domain's classification, which in this case is com- 
mercial as indicated by the com suffix. Such a classification is called a top-level 
domain (TLD). There are numerous TLDs, including edu for educational institu- 
tions, gov forU.S. government institutions, org for nonprofit organizations, museum 
for museums, info for unrestricted use, and net, which was originally intended for 
Internet service providers but is now used on a much broader scale. In addition to 
these general TLDs, there are also two-letter TLDs for specific countries (called coun- 
try-code TLDs) such as au for Australia and ca for Canada. 

Once a domain has a mnemonic name, its local authority is free to extend it to 
obtain mnemonic names for the machines within its domain. For example, an individ- 
ual machine within the domain aw. com might be identified as ssenterprise. aw. com. 

We should emphasize that the dotted notation used in mnemonic addresses is 
not related to the dotted decimal notation used to represent IP addresses. Instead, 
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the sections in a mnemonic address identify the computer's location within a hierar- 
chical classification system. In particular, the address ssenterprise. aw. com indi- 
cates that the computer known as ssenterprise is within the institution aw within 
the class (or TLD) of commercial domains com. In the case of large domains, a local 
authority might break its domain into subdomains, in which case the mnemonic 
addresses of the computers within the domain mightbe longer. For example, suppose 
Nowhere University was assigned the domain name no whereu , edu and chose to 
divide its domain into subdomains. Then, a computer at Nowhere University could 
have an address such as r2d2 . compsc. no whereu. edu, meaning that the computer 
r2d2 is in the subdomain compsc within the domain nowhereu within the class of 
educational domains edu. 

Each domain's local authority is responsible for maintaining a directory containing 
the mnemonic address and the corresponding IP address of those computers within its 
domain. This directory is implemented on a designated computer within the domain 
in the form of a server, called a name server, that responds to requests regarding address 
information. Together, all the name servers throughout the Internet are part of an Inter- 
net-wide directory system known as the domain name system (DNS) that is used to 
convert addresses in mnemonic form into their equivalent bit-pattern forms. In partic- 
ular, when a human requests that a message be sent to a destination identified in 
mnemonic form, DNS is used to convert that mnemonic address into its equivalent IP 
address that is compatible with the Internet software. The process of extracting infor- 
mation from DNS is often referred to as a "DNS lookup." Normally, a DNS lookup is 
completed in a fraction of a second. 


Internet Applications 

In this subsection we discuss three traditional applications of the Internet, and in the 
next section we will explore a fourth. We call these traditional applications because 
they deal with conventional computer-to-computer communication for which the 
Internet was originally developed. Today, however, the distinction between a com- 
puter and other electronic devices is becoming blurred. Telephones, televisions, 
sound systems, burglar alarms, microwave ovens, and video cameras are all becoming 
computers and thus potential "Internet devices." In turn, the traditional applications 
of the Internet will most likely be dwarfed by an expanding flood of new uses, as 
exemplified by the rapidly expanding field of Internet telephony called voice over 
Internet (or more technically voice over IP, abbreviated VoIP), which is simply 
the transmission of telephone data over the Internet rather than traditional tele- 
phone networks. 

in the final analysis, the Internet is merely a communication system over which 
data can be transferred. As technology continues to increase the transfer rates of that 
system, the content of the data being transferred will be limited only by one's imag- 
ination-telephone and radio are already realities. 

For now, however, let us consider three rudimentary "computer oriented" Inter- 
net applications. 
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Electronic Mail One of the most popular uses of the Internet is email (short for 
electronic mail), a system by which messages are transferred among Internet users. 
For the purpose of providing email service, each domain's local authority designates 
a particular machine within its domain to handle the domain's email activities. This 
machine is known as the domain's mail server. Every email message sent from within 
the domain is first sent to the domain's mail server, which then sends the message on 
to its destination. Likewise, every email message addressed to a person within the 
domain is received by the domain's mail server, where it is held until that person 
requests to see his or her incoming mail. 

With the role of a domain's mail server in mind, it is easy to understand the struc- 
ture of an individual's email address. It consists of a symbol string (sometimes called 
the account name) identifying the individual, followed by the symbol @ (read "at"), fol- 
lowed by the mnemonic string that ultimately identifies the mail server that should 
receive the mail. (In reality this string often merely identifies the destination domain, 
and the domain's mail server is ultimately identified by means of a DNS lookup.) 
Thus the email address of an individual at Addison-Wesley Inc. might appear as 
shakespearedaw . com. In other words, a message sent to this address is to go to the 
mail server in the domain aw. com where it should be held for the person identified 
by the symbol string Shakespeare. 

The File Transfer Protocol One means of transferring files (such as documents, 
photographs, or other encoded information) is to attach them to email messages. 
However, a more efficient means is to take advantage of the File Transfer Protocol 
(FTP), which is a client/server protocol for transferring files across the Internet. To 
transfer a file using FTP, a user at one computer in the Internet uses a software pack- 
age that implements FTP to establish contact with another computer. (The original 
computer plays the role of a client. The computer it contacts plays the role of a server, 
which is usually called an FTP server.) Once this connection is established, files can 
be transferred between the two computers in either direction. 

FTP has become a popular way of providing limited access to data via the Inter- 
net. Suppose, for example, that you want to allow certain people to retrieve a file 
while prohibiting access by anyone else. You need merely place the file in a machine 
with FTP server facilities and guard access to the file via a password. Then, people who 
know the password will be able to gain access to the file via FTP, while all others will 
be blocked. A machine in the Internet used in this manner is sometimes called an FTP 
she because it constitutes a location in the Internet at which files are available via FTP. 

FTP sites are also used to provide unrestricted access to files. To accomplish this, 
FTP servers use the term anonymous as a universal login name. Such sites are often 
referred to as anonymous FTP sites and provide unrestricted access to files under 
their auspices. 

A commonly misunderstood feature of FTP is the distinction it makes between 
"text files" and "binary files." The source of this distinction is that when printing a text 
document with early teletype devices, a new line of text required both a line feed (a ver- 
tical movement) and a carriage return (a horizontal movement), each of which is 
encoded individually in ASCII. (A line feed is indicated by the pattern 00001010, whereas 
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POP3 Versus IMAP 


Users of the Internet who obtain email service via remote temporary connec- 
tions to their Internet service provider may have heard of, and perhaps been 
given a choice between, POP3 (pronounced "pop-THREE") and IMAP (pro- 
nounced "EYE-map"). These are protocols by which a user at a remote com- 
puter (perhaps a portable laptop or hand-held PDA) can access the messages 
that have been collected by a mail server and stored in the user's mailbox. POP3 
stands for Post Office Protocol-vers ion 3 and is the simpler of the two. Using 
POP3, a user transfers (downloads) messages to his or her local computer 
where they can be read, stored in various folders, edited, and otherwise manip- 
ulated as the user desires. This activity is done on the user's local machine 
using the local machine's mass storage. IMAP, which stands for Internet Mail 
Access Protocol, allows a user to store and manipulate messages and related 
materials on the same machine as the mail server. In this manner, a user who 
must access his or her email from different computers can maintain records on 
the mail server machine that are then accessible from any remote computer to 
which the user may have access. Thus IMAP provides a higher level of service 
from the ISP maintaining the mail server, and thus the ISP may charge a higher 
fee for IMAP service as opposed to POP3. 


a carriage return is indicated by 00001101.) For the sake of efficiency, many early pro- 
grammers found it convenient to mark line breaks in a text file with only one of these 
codes. For example, if everyone agreed to mark line breaks with only a carriage return 
rather than both a carriage return and a line feed, then eight bits of file space would be 
saved for each line of text in the file. All one had to do was remember to insert a line 
feed each time a carriage return was reached when printing the file. These shortcuts 
have survived in today's systems. In particular, the UNIX operating system assumes 
that a line break in a text file is indicated by only a line feed, whereas systems devel- 
oped by Apple Computer, Inc. use only a carriage return, and Microsoft's operating sys- 
tems require both a carriage return and a line feed. The result is that when these files 
are transferred from one system to another, conversions must be made. 

This, then, leads to the distinction between "text files" and "binary files" in FTP. If 
a file is transferred as a "text file" using FTP the required conversions will be made as 
part of the transfer process; if the file is transferred as a "binary file," no conversions 
will be made. Thus even though you might think of a file produced by a word proces- 
sor as being text, it should not be transferred as a "text file" since these files use pro- 
prietary codes for representing carriage returns and line feeds. If such a "binary file" 
is accidentally transferred as a "text file," it will be subject to unintentional alterations. 

Telnet and Secure Shell One of the early uses of the Internet was to allow com- 
puter users to access computers from great distances. Tblnet is a protocol system that 
was established for this purpose. Using telnet, a user (running telnet client software) 
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can contact the telnet server at a distant computer and then follow that operating sys- 
tem's login procedure to gain access to the distant machine. 

All communication via telnet is carried out in terms of a standard fictitious device, 
called the Network Virtual Terminal (NVT), which was originally envisioned as a key- 
board and a printer. The telnet protocol defines a set of commands for transferring 
characters to and from such a device. All telnet servers are designed to communicate 
via these commands as though they were conversing with an NVT. In turn, all a client 
has to do to communicate with a telnet server is to masquerade as an NVT, Thus, the 
task of a telnet client is to convert the idiosyncrasies of its local system to conform to 
the properties of an NVT. 

Having been designed early in the development of the Internet, telnet has sev- 
eral shortcomings. One of the more critical ones is that communication via telnet is 
not encrypted. This is significant even if the subject of the communication is not sen- 
sitive because the user's password is part of the communication during the login 
process. Thus the use of telnet opens the possibility that an eavesdropper might inter- 
cept a password and later misuse this critical information. Secure Shell (SSH) is a 
communication system that offers a solution to this problem and is rapidly replacing 
telnet. Among the features of SSH is that it provides for encryption of data being trans- 
ferred as well as authentication (Section 4.5), which is the process of making sure 
that the two parties communicating are, in fact, who they claim to be. 


Questions 
& Exercises 


1 . What is the difference between a network identifier and a host address? 

2 What are the components of the complete Internet address of a computer? 

3. What bit pattern is represented by 3.4.5 in dotted decimal notation? Express 
the bit pattern 0001001100010000 using dotted decimal notation. 

4. In what way is the structure of a mnemonic address of a computer on the 
Internet (such as r2d2 . compsc . nowhereu. edu) similar to a traditional 
postal address? Does this same structure occur in IP addresses? 

5 . Name three types of servers found on the Internet and tell what each does. 
6 Why is SSH considered superior to telnet? 


4.3 The World Wide Web 

In this section we focus on an Internet application by which multimedia information 
is disseminated over the Internet. It is based on the concept of hypertext, a term 
that originally referred to text documents that contained links, called hyperlinks, to 
other documents. Today, hypertext has been expanded to encompass images, audio, 
and video, and because of this expanded scope it is sometimes referred to as hyper- 
media. 
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When using a GUI, the reader of a hypertext document can follow the hyperlinks 
associated with it by pointing and clicking with the mouse. For example, suppose 
the sentence "The orchestra's performance of'Bolero' by Maurice Ravel was out- 
standing" appeared in a hypertext document and the name Maurice Ravel was linked 
to another document-perhaps giving information about the composer. A reader 
could choose to view that associated material by pointing to the name Maurice Ravel 
with the mouse and clicking the mouse button. Moreover, if the proper hyperlinks 
are installed, the reader might listen to an audio recording of the concert by click- 
ing on the name Bolero. 

In this manner, a reader of hypertext documents can explore related documents 
or follow a train of thought from document to document. As portions of various doc- 
uments are linked to other documents, an intertwined web of related information is 
formed. When implemented on a computer network, the documents within such a 
web can reside on different machines, forming a network-wide web. The web that 
has evolved on the Internet spans the entire globe and is known as the World Wide 
Web (also referred to as W W W, W3 , or the Web). A hypertext document on the World 
Wide Web is often called a Web page. A collection of closely related Web pages is 
called a website. 

The World Wide Web had its origins in the work of Tim Berners-Lee who real- 
ized the potential of combining the linked-document concept with internet tech- 
nology and produced the first software for implementing the WWW in December 
of 1990. 

Web Implementation 

Software packages that allow users to access hypertext on the Internet fall into one 
of two categories: packages that play the role of clients, and packages that play the role 
of servers. A client package resides on the user's computer and is charged with the 
tasks of obtaining materials requested by the user and presenting these materials to 
the user in an organized manner. It is the client that provides the user interface that 
allows a user to browse within the Web. Hence the client is often referred to as a 
browser, or sometimes as a Web browser. The server package (often called a Web 
server) resides on a computer containing hypertext documents to be accessed. Its 
task is to provide access to the documents on its machine as requested by clients. In 
summary, a user gains access to hypertext documents by means of a browser residing 
on the user's computer. This browser, playing the role of a client, obtains the docu- 
ments by soliciting the services of the Web servers scattered throughout the Internet. 
Hypertext documents are normally transferred between browsers and Web servers 
using a protocol known as the Hypertext Transfer Protocol (HTTP). 

In order to locate and retrieve documents on the World Wide Web, each docu- 
ment is given a unique address called a Uniform Resource Locator (URL). Each URL 
contains the information needed by a browser to contact the proper server and request 
the desired document. Thus to view a Web page, a person first provides his or her 
browser with the URL of the desired document and then instructs the browser to 
retrieve and display the document. 


182 


Networking and the Internet 


Figure 4.8 A typical URL 
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A typical URL is presented in Figure 4.8. It consists of four segments: the proto- 
col to use to communicate with the server controlling access to the document, the 
mnemonic address of the machine containing the server, the directory path needed 
for the server to find the directory containing the document, and the name of the 
document itself. In short, the URL in Figure 4.8 tells a browser to contact the Web 
server o n the computer known a sssenterprise.a w .com using the pi 

and to retrieve the document named Julius_Caesar.html found within the sub- 
directory Shakespeare within the directory called authors. 

Sometimes a URL might not explicitly contain all the segments shown in Figure 
4.8. For example, if the server does not need to follow a directory path to reach the 
document, no directory path will appear in the URL. Moreover, sometimes a URL will 
consist of only a protocol and the mnemonic address of a computer. In these cases, 
the Web server at that computer will return a predetermined document, typically 
called a home page, that usually describes the information available at that website. 

Such shortened URLs provide a simple means of contacting organizations. For exam- 
ple, the URL http://www.aw.com will lead to the home page of Addison-Wesley 
Inc., which contains hyperlinks to numerous other documents relating to the company 
and its products. 

To further simplify locating websites, many browsers assume that the HTTP pro- 
tocol should be used if no protocol is identified. These browsers correctly retrieve the 
Addison-Wesley home page when given the "URL" consisting merely of www. aw. com . 

Of course, a person using the Web might need to research a topic rather than 
retrieve a particular document. For this purpose, many websites (including the home 
pages of most ISPs) provide the services of a search engine. A search engine is a 
software package designed to help Web users identify documents pertaining to var- 
ious subjects. To use a search engine, one types a collection of words or phrases 
that a desired document would probably contain, and then the search engine scans 
its records, reporting the documents whose contents contain the identified text. 

Improving search engine technology, including better methods for identifying 
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The World Wide Web Consortium 


The World Wide Web Consortium (W3C) was formed in 1994 to promote the 
World Wide Webby developing protocol standards (known as W3C standards). 
W3C is headquartered at CERN, the high-energy particle physics laboratory in 
Geneva, Switzerland. CERN is where the original HTML markup language was 
developed as well as the HTTP protocol for transferring HTML documents over 
the Internet, Today W3C is the source of many standards (including standards 
for XML and numerous multimedia applications) that lead to compatibility over 
a wide range of Internet products. You can learn more about W3C via its web- 
site at http://www.w3c.org . 


relevant documents and improved systems for building and storing the underlying 
search engine records, is an ongoing process. 

HTML 

A traditional hypertext document is similar to a text file because its text is encoded 
character by character using a system such as ASCII or Unicode. The distinction is that 
a hypertext document also contains special symbols, called tags, that describe how 
the document should appear on a display screen, what multimedia resources (such 
as images) should accompany the document, and which items within the document 
are linked to other documents. This system of tags is known as Hypertext Markup 
Language (HTML). 

Thus, it is in terms of HTML that an author of a Web page describes the infor- 
mation that a browser needs in order to present the page on the user's screen and to 
find any related documents referenced by the current page. The process is analogous 
to adding typesetting directions to a plain typed text (perhaps using a red pen) so that 
a typesetter will know how the material should appear in its final form. In the case 
of hypertext, the red markings are replaced by HTML tags, and a browser ultimately 
plays the role of the typesetter, reading the HTML tags to learn how the text is to be 
presented on the computer screen. 

The HTML encoded version (called the source version) of an extremely simple 
Web page is shown in Ligure 4.9a. Note that the tags are delineated by the symbols < 
and >. The HTML source document consists oftwo sections-a head (surrounded by 
the <head> and </head> tags) and abody (surroundedby the <body> and </body> 
tags). The distinction between the head and body of a Web page is similar to that of 
the head and body of an interoffice memo. In both cases, the head contains prelimi- 
nary information about the document (date, subject, etc. in the case of a memo). The 
body contains the meat of the document, which in the case of a Web page is the mate- 
rial to be presented on the computer screen when the page is displayed. 

The head of the Web page displayed in Ligure 4.9a contains only the title of the 
document (surrounded by "title" tags). This title is only for documentation purposes; 
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Figure 4.9 A simple Web page 


a. The page encoded using HTML, 
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</head> 

<body> 

<hl>My Web Page</hl> 

<p>Click here for another page.</p> 
</body> 

</html> 


b. The page as it would appear on a computer screen. 



it is not part of the page that is to be displayed on the computer screen. The material 
that is displayed on the screen is contained in the body of the document. 

The first entry in the body of the document in Figure 4.9a is a level-one heading 
(surrounded by the <hl> and </hl> tags) containing the text "My Web Page." Being 
a level-one heading means that the browser should display this text prominently on 
the screen. The next entry in the body is a paragraph of text (surrounded by the <p> 
and </p> tags) containing the text "Click here for another page." Figure 4.9b shows 
the page as it would be presented on a computer screen by a browser. 

In its present form, the page in Figure 4 . 9 is not fully functional in the sense that 
nothing will happen when the viewer clicks on the word here, even though the page 
implies that doing so will cause the browser to display another page. Tb cause the 
appropriate action, we must link the word here to another document. 
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Let us suppose that, when the word here is clicked, we want the browser to retrieve 
and display the page at the URL http: / /crafty, com/demo .html. To do so, we must 
first surround the word here in the source version of the page with the tags <a> and </&>, 
which are called anchor tags. Inside the opening anchor tag we insert the parameter 

href = "http://crafty.com/demo.html" 

(as shown in Figure 4.10a) indicating that the hypertext reference (href) associated 
with the tag is the URL following the equal sign fhttp : //crafty, com/demo. html). 

Figure 4. 1 0 An enhanced simple Web page 


a. The page encoded using HTML. 
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b. The page as itwould appear on a computer screen. 
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Having added the anchor tags, the Web page will now appear on a computer screen 
as shown in Figure 4.10b. Note that this is identical to Figure 4.9b except that the word 
here is highlighted by color indicating that it is a link to another Web document. Click- 
ing on such highlighted terms will cause the browser to retrieve and display the asso- 
ciated Web document. Thus, it is by means of anchor tags that Web documents are 
linked to each other. 

Finally, we should indicate how an image could be included in our simple Web 
page. For this purpose, let us suppose that a JPEG encoding of the image we want to 
include is stored in the same directory as the HTML source version of the page at the 
HTTP server site. Moreover, let us suppose that the name of the image file is Our Im- 
age, jpg. Under these conditions, we can tell a browser to display the image at the 
top of the Web page by inserting the image tag 

<img src = "Ourlmage.jpg"> 

immediately after the <body> tag in the HTML source document. This tells the 
browser that the image named Ourlmage. jpg should be displayed at the beginning 
of the document. (The term src is short for "source," meaning that the information 
following the equal sign indicates the source of the image to be displayed.) When the 
browser finds this tag, it will send a message back to the HTTP server from which it 
got the original document requesting the image called Ourlmage. j pg and then dis- 
play the image appropriately. 

If we moved the image tag to the end of the document just before the </body> 
tag, then the browser would display the image at the bottom of the Web page. There 
are, of course, more sophisticated techniques for positioning an image on a Web page, 
but these need not concern us now. 


XML 

HTML is essentially a notational system by which a text document along with the 
document's appearance can be encoded as a simple text file. In a similar manner we 
can also encode nontextual material as text files-an example being sheet music. At 
first glance the pattern of staffs, measure bars, and notes in which music is tradi- 
tionally represented does not conform to the character-by-character format dictated 
by text files. However, we can overcome this problem by developing an alternative 
notation system. More precisely, we could agreed to represent the start of a staff by 
<staff clef = " treble ">, the end of the staffby </staff>, a time signature 

with the form <time> 2/4 </time>, the beginning and ending of a measure by 
<measure> and </measure>, respectively, a note such as an eighth note on C as 
<notes> egth C </notes>, etc. Then the text 

<Staff clef = "treble"> <key>C minor</key> 

<time> 2/4 </time> 

<measure> <rest> egth </rest> <notes> egth G, 
egth G, egth G </n o t e s x/m e a s u r e > 

<measure> <notes> hlf E </notesx/measure> 

</staff> 
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Figure 4.1 1 The first two bars of Beethoven's Fifth Symphony 
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could be used to encode the music shown in Figure 4.11. Using such notation, sheet 
music could be encoded, modified, stored, and transferred over the Internet as text 
files. Moreover, software could be written to present the contents of such files in the 
form of traditional sheet music or even to play the music on a synthesizer. 

Note that our sheet music encoding system encompasses the same style used by 
HTML, We chose to delineate the tags that identify components by the symbols < and 
>. We chose to indicate the beginning and end of structures (such as a staff, a string 
of notes, or a measure) by tags of the same name-the ending tag being designated 
by a slash (a <measure> was terminated with the tag </measure>). And we chose 
to indicate special attributes within tags by expressions such as clef = "treble". 
This same style could also be used to develop systems for representing other formats 
such as mathematical expressions and graphics. 

The extensible Markup Language (XML) is a standardized style (similar to 
that of our music example) for designing notational systems for representing data as 
text files. (Actually, XML is a simplified derivative of an older set of standards called 
the Standard Generalized Markup Language, better known as SGML.) Following the 
XML standard, notational systems called markup languages have been developed for 
representing mathematics, multimedia presentations, and music. In fact, HTML is 
the markup language based on the XML standard that was developed for representing 
Web pages. (Actually, the original version of HTML was developed before the XML 
standard was solidified, and therefore some features of HTML do not strictly conform 
to XML. That is why you might see references to XHTML, which is the version of 
HTML that rigorously adheres to XML.) 

XML provides a good example of how standards are designed to have wide-ranging 
applications. Rather than designing individual, unrelated markup languages for encod- 
ing various types of documents, the approach represented by XML is to develop a 
standard for markup languages in general. With this standard, markup languages can 
be developed for various applications. Markup languages developed in this manner 
possess a uniformity that allows them to be combined to obtain markup languages for 
complex applications such as text documents that contain segments of sheet music 
and mathematical expressions. 

Finally we should note that XML allows the development of new markup lan- 
guages that differ from HTML in that they emphasize semantics rather than appear- 
ance. For example, with HTML the ingredients in a recipe can be marked so that they 
appear as a list in which each ingredient is positioned on a separate line. But if we 
used semantic-oriented tags, ingredients in a recipe could be marked as ingredients 
(perhaps using the tags <ingredient> and </ingredients) rather than merely 
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items in a list. The difference is subtle but important. The semantic approach would 
allow search engines to identify recipes that contain or do not contain certain ingre- 
dients, which would be a substantial improvement over the current state of the art in 
which only recipes that do or do not contain certain words can be isolated. More pre- 
cisely, if semantic tags are used, a search engine can identify recipes for lasagna that 
do not contain spinach, whereas a similar search based merely on word content would 
skip over a recipe that started with the statement "This lasagna does not contain 
spinach." In turn, by using an Internet- wide standard for marking documents accord- 
ing to semantics rather than appearance, a World Wide Semantic; Web, rather than the 
World Wide Syntactic Web we have today, would be created. 


Client-Side and Server-Side Activities 

Consider now the steps that would be required for a browser to retrieve the simple Web 
page shown in Figure 4.10 and display it on the browser's computer screen. First, 
playing the role of a client, the browser would use the information in a URL (perhaps 
obtained from the person using the browser) to contact the Web server controlling 
access to the page and ask that a copy of the page be transferred to it. The server 
would respond by sending the text document displayed in Figure 4.10a to the browser. 
The browser would then interpret the HTML tags in the document to determine how 
the page should be displayed and present the document on its computer screen accord- 
ingly. The user of the browser would see an image like, that depicted in Figure 4.10b. 
If the user then clicked the mouse over the word here, the browser would use the URL 
in the associated anchor tag to contact the appropriate server to obtain and display 
another Web page. In summary, the process consists of the browser merely fetching 
and displaying Web pages as directed by the user. 

But what if we wanted a Web page involving animation or one that allows a cus- 
tomer to fill out an order form and submit the order? These needs would require addi- 
tional activity by either the browser or the Web server. Such activities are called 
client-side activities if they are performed by a client (such as a browser) or server- 
side activities if they are performed by a server (such as a Web server). 

Animation on a Web page is normally a client-side activity. The information 
required for the animation is transferred to the browser along with the Web page doc- 
ument. Then the animation is implemented under control of the browser. 

In contrast, suppose a travel agent wanted customers to be able to identify desired 
destinations and dates of travel, at which time the agent would present the customer 
with a customized Web page containing only the information pertinent to that cus- 
tomer's needs. In this case the travel agent's website would first provide a Web page 
that presented a customer with the available destinations. On the basis of this infor- 
mation, the customer would specify the destinations of interest and desired dates of 
travel (a client-side activity). This information would then be transferred back to the 
agent's server where it would be used to construct the appropriate customized Web 
page (a server-side activity) which would then be sent to the customer's browser. 

A similar example occurs in the case of a person using the services of a search 
engine. Here the person specifies a topic of interest (a client-side activity) which is then 
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transferred to the search engine where a customized Web page identifying documents 
of possible interest is constructed (a server-side activity) and sent back to the client. 

There are numerous systems for performing client- and server-side activities, 
each competing with the others for prominence. An early and still popular means of 
controlling client-side activities is to include programs written in the language 
JavaScript (developed by Netscape Communications, Inc.) within the HTML source 
document for the Web page. From there a browser can extract the programs and fol- 
low them as needed. Another approach (developed by Sun Microsystems) is to first 
transfer a Web page to a browser and then transfer additional program units called 
applets (written in the language Java) to the browser as requested within the HTML 
source document. Still another approach is the system Flash (developed by Macro- 
media) by which extensive multimedia client-side presentations can be implemented. 

An early means of controlling server-side activities was to use a set of standards 
called CGI (Common Gateway Interface) by which clients could request the execution 
of programs stored at a server. A variation of this approach (developed by Sun 
Microsystems) is to allow clients to cause program units called servlets to be executed 
at the server side. A simplified version of the servlet approach is applicable when the 
requested server-side activity is the construction of a customized Web page, as in our 
travel agent example. In this case Web page templates called JavaServer Pages (JSP) 
are stored at the Web server and completed using information received from a client, 
A similar approach is used by Microsoft, where the templates from which customized 
Web pages are constructed are called Active Server Pages (ASP). In contrast to these 
proprietary systems, PHP (originally standing for Personal Home Page but now con- 
sidered to mean PHP Hypertext Processor) is an open source system for implementing 
server-side functionality. 

Finally, we would be remiss if we did not recognize the security and ethical prob- 
lems that arise from allowing clients and servers to execute programs on the other's 
machine. The fact that Web servers routinely transfer programs to clients where they 
are executed leads to ethical questions on the server side and security questions on the 
client side. If the client blindly executes any program sent to it by a Web server, it 
opens itself to malicious activities by the server. Likewise, the fact that clients can 
cause programs to be executed at the server leads to ethical questions on the client side 
and security questions on the server side. If the server blindly executes any program 
sent to it by a client, security breaches and potential damage at the server could result. 


1 What is a URL? What is a browser? 

2. What is a markup language 7 

3. What is the difference between HTML and XML? 

4. What is the purpose of each of the following HTML tags? 
a. <html> b. <head> c. </body> d. </a> 

5. To what do the terms client side and server side refer? 


Questions 
& Exercises 
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4.4 Internet Protocols 

In this section we investigate how messages are transferred over the Internet. This 
transfer process requires the cooperation of all the computers in the system, and 
therefore software for controlling this process resides on every computer in the Inter- 
net. We begin by studying the overall structure of this software. 

The Layered Approach to Internet Software 

A principal task of networking software is to provide the infrastructure required 
for transferring messages from one machine to another. In the Internet, this mes- 
sage-passing activity is accomplished by means of a hierarchy of software units, 
which perform tasks analogous to those that would be performed if you were to 
send a gift in a package from the West Coast of the United States to a friend on the 
East Coast (Figure 4.12). You would first wrap the gift as a package and write the 
appropriate address on the outside of the package. Then, you would take the pack- 
age to a shipping company such as the U.S. Postal Service. The shipping company 
might place the package along with others in a large container and deliver the con- 
tainer to an airline, whose services it has contracted. The airline would place the 
container in an aircraft and transfer it to the destination city, perhaps with inter- 
mediate stops along the way. At the final destination, the airline would remove the 
container from the aircraft and give it to the shipping company's office at the des- 
tination. In turn, the shipping company would take your package out of the con- 
tainer and deliver it to the addressee. 


Figure 4.12 Package-shipping example 
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In short, the transportation of the gift would be carried out by a three-level hier- 
archy: (1) the user level (consisting of you and your friend), (2) the shipping com- 
pany, and (3) the airline. Each level uses the next lower level as an abstract tool. 
(You are not concerned with the details of the shipping company, and the shipping 
company is not concerned with the internal operations of the airline.) Each level in 
the hierarchy has representatives at both the origin and the destination, with the 
representatives at the destination tending to do the reverse of their counterparts at 
the origin. 

Such is the case with software for controlling communication over the Internet, 
except that the Internet software has four layers rather than three, each consisting of 
a collection of software routines rather than people and businesses. The four layers 
are known as the application layer, the transport layer, the network layer, and the 
link layer (Figure 4.13). All layers are present on each computer in the Internet. A 
message typically originates in the application layer. From there it is passed down 
through the transport and network layers as it is prepared for transmission, and finally 
it is transmitted by the link layer. The message is received by the link layer at the des- 
tination and passed back up the hierarchy until it is delivered to the application layer 
at the message's destination. 

Let us investigate this process more thoroughly by tracing a message as it finds 
its way through the system (Figure 4.14). We begin our journey with the applica- 
tion layer. 

The application layer consists of those software units such as clients and servers 
that use Internet communication to carry out their tasks. Although the names are 
similar, this layer is not restricted to software in the application classification pre- 
sented in Section 3.2, but also includes many utility packages. For example, software 


Figure4.13 The Internet software layers 
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Figure 4. 14 Following a message through the Internet 
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for transferring files using FTP or for providing remote login capabilities using telnet 
have become so common that they are normally considered utility software. 

The application layer uses the transport layer to send and receive messages over 
the Internet in much the same way that you would use a shipping company to send 
and receive packages. Just as it is your responsibility to provide an address compati- 
ble with the specifications of the shipping company, it is the application layer’s respon- 
sibility to provide an address that is compatible with the transport layer. (To fulfill 
this need, the application layer may use the services of the name servers within the 
Internet to translate mnemonic addresses used by humans into Internet-compatible 
IP addresses.) 
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A major task of the transport layer is to accept messages from the application 
layer and to ensure that the messages are properly formatted for transmission over 
the Internet. Toward this latter goal, the transport layer divides long messages into 
small segments, which are transmitted over the Internet as individual units. This divi- 
sion is necessary because a single long message can obstruct the flow of other mes- 
sages at the points on the Internet where numerous messages must cross paths. 
Indeed, small segments of messages can interweave at these points, whereas a long 
message forces others to wait while it passes (much like cars waiting for a long train 
to pass at a railroad crossing). 

The transport layer adds sequence numbers to the small segments it produces so 
that the segments can be reassembled at the message's destination. Then it attaches 
the destination address to each segment and hands these addressed segments, known 
as packets, to the network layer. From this point, the packets are treated as individ- 
ual, unrelated messages until they reach the transport layer at their final destination. 
It is quite possible for the packets related to a common message to follow different 
paths through the Internet. 

The network layer has the task of forwarding the packets it receives from one 
network within the Internet to another until they reach their final destinations. Thus 
it is the network layer that must deal with the Internet's topology. In particular, if a 
packet's path through the Internet must pass through many individual networks, it is 
the network layer at each intermediate stop that determines the direction in which 
the packet will be sent next. The decision is made as follows: If the final destination 
of the packet is within the current network, the network layer will send the packet 
there; otherwise, the network layer will send the packet to a router in the current 
network through which the packet can be transferred into an adjacent network. In this 
way, a packet destined for a computer within the current network will be sent to that 
machine, whereas a packet destined for a computer outside the current network will 
continue its network-to-network journey . 

Having determined a packet's next destination, the network layer appends this 
address to the packet as an intermediate address and hands the packet to the link layer. 

The link layer has the responsibility of transferring the packet to the intermedi- 
ate address that was determined by the network layer. Thus the link layer must deal 
with the communication details particular to the individual network in which the 
computer resides. If that network is a token ring, the link layer must wait for pos- 
session of the token before transmitting. If the network uses CSMA/CD, the link layer 
must listen for a silent bus before transmitting. 

When a packet is transmitted, it is received by the link layer at the computer des- 
ignated by the local address attached to the message. There, the link layer hands the 
packet up to its network layer where the packet's final destination is compared to the 
current location. If these do not coincide, the network layer determines a new inter- 
mediate address for the packet, attaches that address to the packet, and returns the 
packet to the link layer for retransmission. In this manner, each packet hops from 
machine to machine on its way to its final destination. Note that only the link and 
network layers are involved at the intermediate stops during this journey (see again 
Figure 4.14). 
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If the network layer determines that an arriving packet has reached its final des- 
tination, it hands the packet to its transport layer. As the transport layer receives pack- 
ets from the network layer, it extracts the underlying message segments and 
reconstructs the original message according to the sequence numbers that were pro- 
vided by the transport layer at the message’s origin. Once the message is assembled, 
the transport layer hands it to the appropriate unit within the application layer-thus 
completing the message transmission process. 

Determining which unit within the application layer should receive an incoming 
message is an important task of the transport layer. This is handled by assigning 
unique port numbers (not related to the I/O ports discussed in Chapter 2) to the 
various units and requiring that the appropriate port number be appended to a mes- 
sage's address before starting the message on its journey. Then, once the message is 
received by the transport layer at the destination, the transport layer merely hands 
the message to the application layer software at the designated port number. 

Users of the Internet rarely need to be concerned with port numbers because the 
common applications have universally accepted port numbers. For example, if a Web 
browser is asked to retrieve the document whose URL is http://www.zoo.org/ 
animals/frog, html, the browser assumes that it should contact the HTTP server 
at w w . zoo. org via port number 80. Likewise, when transferring a file, an FTP 
client assumes that it should communicate with the FTP server through port numbers 
20 and 21. 

In summary, communication over the Internet involves the interaction of four lay- 
ers of software. The application layer deals with messages from the application's point 
of view. The transport layer converts these messages into packets that are compati- 
ble with the Internet and reassembles messages that are received before delivering 
them to the appropriate application. The network layer deals with directing the pack- 
ets through the Internet. The link layer handles the actual transmission of packets 
from one machine to another. With all this activity, it is somewhat amazing that the 
response time of the Internet is measured in milliseconds, so that many transactions 
appear to take place instantaneously. 


The TCP/IP Protocol Suite 

The demand for open networks has generated a need for published standards by 
which manufacturers can supply equipment and software that function properly with 
products from other vendors. One standard that has resulted is the Open System Inter- 
connection (OSI) reference model, produced by the International Organization for 
Standardization. This standard is based on a seven-level hierarchy as opposed to the 
four-level hierarchy we have just described. It is an often-quoted model because it 
carries the authority of an international organization, but it has been slow to replace 
the four-level point of view, mainly because it was established after the four-level 
hierarchy had already become the de facto standard for the Internet. 

The TCP/IP protocol suite is a collection of protocols used by the Internet to 
implement the four-level communication hierarchy implemented in the Internet. 
Actually, the Transmission Control Protocol (TCP) and the Internet Protocol (IP) 
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are the names of only two of the protocols in this vast collection-so the fact that the 
entire collection is referred to as the TCP/IP protocol suite is rather misleading. More 
precisely, TCP defines a version of the transport layer. We say a version because the 
TCP/IP protocol suite provides for more than one way of implementing the transport 
layer; another is defined by the User Datagram Protocol (UDP) . This dichotomy is 
analogous to the fact that when shipping a package, you have a choice of different ship- 
ping companies, each of which offers the same basic service but with its own unique 
characteristics. Thus, depending on the particular quality of service required, a unit 
within the application layer might choose to semi data via a TCI 1 or UDP version ol 
the transport layer (Figure 4.15). 

There are two basic differences between TCP and UDP. The first is that before 
sending a message as requested by the application layer, a transport layer based on 
TCP sends its own message to the transport layer at the destination telling it that a 
message is about to be sent. It then waits for this message to be acknowledged before 
starting to send the application layer's message. In this manner, a TCP transport layer 
is said to establish a connection before sending a message. A transport layer based on 
UDP does not establish such a connection prior to sending a message. It merely sends 
the message to the address it was given and forgets about it. For all it knows, the des- 
tination computer might not even be operational. For this reason, UDP is called a 
connectionless protocol. 

The second basic difference between TCP and UDP is that TCP transport layers at 
the origin and destination work together by means of acknowledgments and packet 
retransmissions to confirm that all segments of a message are successfully transferred 
to the destination. TCP is called a reliable protocol, whereas UDP which does not offer 
such retransmission services, is said to be an unreliable protocol. This does not mean 
that UDP is a poor choice. After all, a transport layer based on UDP is more streamlined 
than a layer based on TCP, and thus if an application is prepared to handle the poten- 
tial consequences of UDP that option might be the better choice. For example, email is 
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normally sent via TCP, but the communication carried out by the name servers when 
translating addresses from mnemonic form into IP form uses UDP 

IP is the Internet's standard for the network layer. Among its features is that each 
time an IP network layer prepares a packet to be handed to the link layer, it appends 
a value called a hop count, or time to live, to that packet. This value is a limit to the 
number of times the packet should be forwarded as it tries to find its way through the 
Internet. Each time an IP network layer forwards a packet, it decrements that packet's 
hop count by one. With this information, the network layer can protect the Internet 
from packets circling endlessly within the system. Although the Internet continues 
to grow on a daily basis, an initial hop count of 64 remains more than sufficient to 
allow a packet to find its way through the maze of LANs, MANs, WANs, and routers. 

For years a version of IP known as IPv4 (IP version four) has been used for imple- 
menting the network layer within the Internet. However, the Internet is rapidly out- 
growing the 32-bit internet addressing system dictated by IPv4. Thus, a new version 
of IP known as IPv6, which uses internet addresses consisting of 128 bits, has been 
established. The process of converting from IPv4 to IPv6 is currently underway. (This 
is the conversion that was alluded to in our introduction of Internet addresses in Sec- 
tion 4.2.) In some areas, IPv6 is actually being used; in others, the conversion is still 
several years away. For example, current plans are for the U.S. government to convert 
to IPv6 by 2008. In any case, 32-bit addresses within the Internet are expected to be 
extinct by 2025. 


Questions 
& Exercises 


1. What layers of the Internet software hierarchy are used to forward an incoming 
message to another machine? 

2 What are some differences between a transport layer based on the TCP 
protocol and another based on the UDP protocol? 

3. How does the Internet software ensure that are tiOt relayed within 

the Internet forever? 

4 What keeps a computer on the Interniett froiifl recording copies of all tthe 
messages passing through it? 


4.5 Security 

When a computer is connected to a network, it becomes subject to unauthorized 
access and vandalism. In this section we address topics associated with these problems. 


Forms of Attack 

There are numerous ways that a computer system and its contents can be attacked 
via network connections. Many of these incorporate the use of malicious software 
(collectively called malware.) Such software might be transferred to, and executed on. 
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the computer itself, or it might attack the computer from a distance. Examples of soft- 
ware that is transferred to, and executed on, the computer under attack include 
viruses, worms, Trojan horses, and spyware, whose names reflect the primary char- 
acteristic of the software. 

A virus is software that infects a computer by inserting itself into programs that 
already reside in the machine. Then, when the "host" program is executed, the virus 
is also executed. When executed, many viruses do little more than try to transfer 
themselves to other programs within the computer. Some viruses, however, perform 
devastating actions such as degrading portions of the operating system, erasing large 
blocks of mass storage, or otherwise corrupting data and other programs. 

A worm is an autonomous program that transfers itself through a network, tak- 
ing up residence in computers and forwarding copies of itself to other computers. As 
in the case of a virus, a worm can be designed merely to replicate itself or to perform 
more extreme vandalism. A characteristic consequence of a worm is an explosion of 
the worm's replicated copies that degrades the performance of legitimate applications 
and can ultimately overload an entire network or internet. 

A Trojan horse is a program that enters a computer system disguised as a desir- 
able program, such as a game or a useful utility package, that is willingly imported by 
the victim. Once in the computer, however, the Trojan horse performs additional activ- 
ities that might have harmful effects. Sometimes these additional activities start imme- 
diately. In other instances, the Trojan horse might lie dormant until triggered by a 
specific event such as the occurrence of a pre-selected date. Trojan horses often arrive 
in the form of attachments to enticing email messages. When the attachment is opened 
(that is, when the recipient asks to view the attachment), the misdeeds of the Trogan 
horse are activated. Thus, email attachments from unknown sources should never 
be opened. 

Another form of malicious software is spyware (sometimes called sniffing soft- 
ware), which is software that collects information about activities at the computer on 
which it resides and reports that information back to the instigator of the attack. Some 
companies use spyware as a means of building customer profiles, and in this context, 
it has questionable ethical merit. In other cases, spyware is used for blatantly mali- 
cious purposes such as recording the symbol sequences typed at the computer's key- 
board in search of passwords or credit card numbers. 

As opposed to obtaining information secretly by sniffing via spyware, phishing 
is a technique of obtaining information explicitly by simply asking for it. The term 
phishing is a play on the word fishing since the process involved is to cast numerous 
"lines" in hopes that someone will "take the bait." Phishing is often carried out via 
email, and in this form, it is little more than an old telephone con. The perpetrator 
sends email messages posing as a financial institution, a government bureau, or per- 
haps a law enforcement agency. The email asks the potential victim for information 
that is supposedly needed for legitimate purposes. However, the information obtained 
is used by the perpetrator for hostile purposes. 

In contrast to suffering from such internal infections as viruses and spyware, a 
computer in a network can also be attacked by software being executed on other com- 
puters in the system. An example is a denial of service attack, which is the process 
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of overloading a computer with requests. Denial of service attacks have been launched 
against large commercial Web servers on the Internet to disrupt the company's busi- 
ness and in some cases have brought the company's commercial activity to a halt. 

A denial of service attack requires the generation of a large number of requests 
over a brief period of time. To accomplish this, an attacker usually plants software on 
numerous unsuspecting computers that will generate requests when a signal is given. 
Then, when the signal is given, all of these computers swamp the target with messages. 
Inherent, then, in denial of service attacks is the availability of unsuspecting com- 
puters to use as accomplices. This is why all PC users are discouraged from leaving 
their computers connected to the Internet when not in use. It has been estimated 
that once a PC is connected to the Internet, at least one intruder will attempt to exploit 
its existence within 20 minutes. In turn, an unprotected PC represents a significant 
threat to the integrity of the Internet. 

Another problem associated with an abundance of unwanted messages is the 
proliferation of unwanted junk email, called spam. However, unlike a denial ofserv- 
ice attack, the volume of spam is rarely sufficient to overwhelm the computer system. 
Instead, the effect of spam is to overwhelm the person receiving the spam. This prob- 
lem is compounded by the fact that, as we have already seen, spam is a widely adopted 
medium for phishing and instigating Trojan horses that might spread viruses and other 
detrimental software. 

Protection and Cures 

The old adage "an ounce of prevention is worth a pound of cure" is certainly true in 
the context of controlling vandalism over network connections. A primary prevention 
technique is to filter traffic passing through a point in the network, usually with a 
program called a firewall. For instance, a firewall might be installed at a domain's gate- 
way to filter messages passing in and out of the domain. Such firewalls might be 
designed to block outgoing messages with certain destination addresses or to block 
incoming messages from origins that are known to be sources of trouble. This latter 
function is a tool for terminating a denial of service attack since it provides a means 
of blocking traffic from the attacking computers. Another common role of a firewall 
at a domain's gateway is to block all incoming messages that have origin addresses 
within the domain since such a message would indicate that an outsider is pretending 
to be a member of the domain. Masquerading as a party other than one's self is known 
as spoofing. 

Firewalls are also used to protect individual computers rather than entire net- 
works or domains. For example, if a computer is not being used as a Web server, a 
name server, or an email server, then a firewall should be installed at that computer 
to block all incoming traffic addressed to such applications. Indeed, one way an 
intruder might gain entry to a computer is by establishing contact through a "hole" left 
by a nonexistent server. In particular, one method for retrieving information gath- 
ered by spyware is to establish a clandestine server on the infected computer by which 
malicious clients can retrieve the spyware's findings. A properly installed firewall 
could block the messages from these malicious clients. 
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Some variations of firewalls are designed for specific purposes-an example being 
spam filters, which are firewalls designed to block unwanted email. Many spam fil- 
ters use rather sophisticated techniques to distinguish between desirable email and 
spam. Some learn to make this distinction via a training process in which the user 
identifies items of spam until the filter acquires enough examples to make decisions 
on its own. These filters are examples of how a variety of subject areas (probability the- 
ory, artificial intelligence, etc.) canjointly contribute to developments in other fields. 

Another preventative tool that has filtering connotations is the proxy server. A 
proxy server is a software unit that acts as a intermediary between a client and a 
server with the goal of shielding the client from adverse actions of the server. Without 
a proxy server, a client communicates directly with a server, meaning that the server 
has an opportunity to learn a certain amount about the client. Over time, as many 
clients within the same domain deal with a distant server, that server can collect a 
multitude of information about the domain-information that can later be used to 
attack the domain. To counter this, a domain might contain a proxy server for a par- 
ticular kind of service (FTP, HTTP, telnet, etc.). Each time a client within the domain 
tries to contact a server of that type, the client is actually placed in contact with the 
proxy server. Then the proxy server, playing the role of a client, contacts the actual 
server. From then on the proxy server plays the role of an intermediary between the 
actual client and the actual server by relaying messages back and forth. The first advan- 
tage of this arrangement is that the actual server has no way of knowing that the proxy 
server is not the true client, and in fact, it is never aware of the actual client's existence. 
In turn, the actual server has no way of learning about the domain's internal features. 
The second advantage is that the proxy server is in position to filter all the messages 
sent from the server to the client. For example, an FTP proxy server could check all 
incoming files for the presence of known viruses and block all infected files. 

Still another tool for preventing problems in a network environment is auditing 
software that is similar to the utility packages we learned about in our discussion on 
operating system security (Section 3.5). Using network-level auditing software, a sys- 
tem administrator can detect a sudden increase in message traffic at various loca- 
tions within a domain, monitor the activities of the system's firewalls, and analyze the 
pattern of requests being made by the individual computers within the administrator's 
realm in order to detect irregularities. In effect, auditing software is an administrator's 
primary tool for identifying problems before they grow out of control. 

Another means of defense against invasions via network connections is software 
called antivirus software, which is used to detect and to remove the presence of 
known viruses and other infections. (Actually, antivirus software represents a broad 
class of software products, each designed to detect and remove a specific type of infec- 
tion. For example, while many products specialize in virus control, others specialize 
in spyware protection.) It is important for users of these packages to understand that, 
just as in the case of biological systems, new computer infections are constantly com- 
ing on the scene that require updated vaccines. Thus, antivirus software must be rou- 
tinely maintained by downloading updates from the software's vendor. Even this, 
however, does not guarantee the safety of a computer. After all, a new virus must first 
infect some computers before it is discovered and a vaccine is produced. Thus, a wise 
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Pretty Good Privacy 

Perhaps the most popular public-key encryption systems used within the Inter- 
net are based on the RSA algorithm, named after its inventors Ron Rivest, Adi 
Shamir, and Len Adleman, which we will discuss in detail at the end of Chapter 
11. RSA techniques (among others) are used in a collection of software packages 
produced by PGP Corporation. PGP stands for Pretty Good Privacy. These pack- 
ages are compatible with most email software used on PCs and are available 

without charge for personal, noncommercial use at I 

Using PGP software, an individual can generate public and private keys, 
encrypt messages with public keys, and decrypt messages with private keys. 


computer user never opens email attachments from unfamiliar sources, does not down- 
load software without first confirming its reliability, does not respond to pop-up adds, and 
does not leave a PC connected to the Internet when such connection is not necessary. 

Encryption 

In some cases the purpose of network vandalism is to disrupt the system (as in denial 
of service attacks), but in other cases the ultimate goal is to gain access to informa- 
tion. The traditional means of protecting information is to control its access through 
the use ofpasswords. However, passwords can be compromised and are of little value 
when data are transferred over networks and internets where messages are relayed 
by unknown entities. In these cases encryption can be used so that even if the data 
fall into unscrupulous hands, the encoded information will remain confidential. Today, 
many traditional Internet applications have been altered to incorporate encryption 
techniques, producing what are called "secure versions" of the applications. Exam- 
ples include FTPS, which is a secure version of FTP, and SSH, which we introduced 
in Section 4.2 as a secure replacement for telnet. 

Still another example is the secure version of HTTP, known as HTTPS , which is 
used by most financial institutions to provide customers with secure Internet access 
to their accounts. The backbone of HTTPS is the protocol system known as Secure 
Sockets Layer (SSL), which was originally developedby Netscape to provide secure 
communication links between Web clients and servers. Most browsers indicate the use 
of SSL by displaying a tiny padlock icon on the computer screen. (Some use the pres- 
ence or absence of the icon to indicate whether SSL is being used, others display the 
padlock in either locked or unlocked position.) 

One of the more fascinating techniques in the field of encryption is public-key 
encryption, which is an encryption system in which knowing how to encrypt mes- 
sages does not allow one to decrypt messages — a property that might seem counter- 
intuitive. After all, intuition would suggest that a person who knows how messages 
are encrypted should be able to reverse the process to decrypt messages. But, this is 
not true when public-key encryption techniques are used. 
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A public-key encryption system involves the use of two values called keys. 
One key, known as the public key, is used to encrypt messages; the other key, 
known as the private key, is required to decrypt messages. To use the system, the 
public key is first distributed to those who might need to send messages to a par- 
ticular destination. The private key is held in confidence at this destination. Then, 
the originator of a message can encrypt the message using the public key and send 
the message to its destination with assurance that its contents are safe, even if it is 
handled by intermediaries who also know the public key. Indeed, the only party that 
can decrypt the message is the party at the message's destination who holds the pri- 
vate key. Thus if Bob creates a public-key encryption system and gives both Alice 
and Carol the public key, then both Alice and Carol can encrypt messages to Bob, 
but they cannot spy on the other’s communication. Indeed, if Carol intercepts a 
message from Alice, she cannot decrypt it even though she knows how Alice 
encrypted it (Figure 4.16). 

There are, of course, subtle problems lurking within public-key systems. One is 
to ensure that the public key being used is, in fact, the proper key for the destination 
party. For example, if you are communicating with your bank, you want to be sure 
that the public key you are using for encryption is the one for the bank and not an 
impostor. If an impostor presents itself as the bank (a process known as spoofing) and 
gives you its public key, the messages you encrypt and send to the "bank" would be 
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meaningful to the impostor and not your bank. Thus, the task of associating public 
keys with correct parties is significant. 

One approach to resolving this problem is to establish trusted Internet sites, called 
certificate authorities, whose task is to maintain accurate lists of parties and their 
public keys. These authorities, acting as servers, then provide reliable public-key 
information to their clients in packages known as certificates. A certificate is a pack- 
age containing a party's name and that party's public key. Many commercial certifi- 
cate authorities are now available on the Internet, although it is also common for 
organizations to maintain their own certificate authorities in order to maintain tighter 
control over the security of the organization's communication. 

Finally, we should comment on the role public-key encryption systems play in 
solving problems of authentication-making sure that the author of a message is, in 
fact, the party it claims to be. The critical point here is that, in some public-key encryp- 
tion systems, the roles of the encryption and decryption keys can be reversed. That 
is, text can be encrypted with the private key, and since only one party has access to 
that key, any text that is so encrypted must have originated from that party. In this 
manner, the holder of the private key can produce a bit pattern, called a digital sig- 
nature, that only that party knows how to produce. By attaching that signature to a 
message, the sender can mark the message as being authentic. A digital signature can 
be as simple as the encrypted version of the message itself. All the sender must do is 
encrypt the message being transmitted using his or her private key (the key usually 
used for decrypting). When the message is received, the receiver uses the senders pub- 
lic key to decrypt the signature. The message that is revealed is guaranteed to be 
authentic because only the holder of the private key could have produced the 
encrypted version. 


Legal Approaches to Network Security 

Another way of enhancing the security of computer networking systems is to apply 
legal remedies. There are, however, two obstacles to this approach. The first is that 
making an action illegal does not preclude the action. All it does is provide a legal 
recourse. The second is that the international nature of networking means that obtain- 
ing recourse is often very difficult, what is illegal in one country might be legal in 
another. Ultimately, enhancing network security by legal means is an international 
project, and thus must be handled by international legal bodies-a potential player 
would be the International Court of Justice in The Hague. 

Having made these disclaimers, we must admit that, although less than perfect, 
legal forces still have a tremendous influence, and thus it behooves us to explore 
some of the legal steps that are being taken to resolve conflicts in the networking 
arena. For this purpose, we use examples from the federal laws of the United States. 
Similar examples could be drawn from other government bodies such as the Euro- 
pean Union. 

We begin with the proliferation of malware. In the United States this problem is 
addressed by the Computer Fraud and Abuse Act, which was first passed in 1984 
although it has been amended several times. It is under this act that most cases involv- 
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The Computer Emergency Response Team 

In November 1988 a worm released into the Internet caused significant disrup- 
tion of service. Consequently, the U.S. Defense Advanced Research Projects 
Agency (D ARP A-pronounced "DAR-pa") formed the Computer Emergency 
Response Team (CERT -pronounced "SERT"), located at the CERT Coordination! 
Center at Carnegie-Mellon University. The CERT is the Internet's security 
"watchdog." Among its duties are the investigation of security problems, the 
issuance of security alerts, and the implementation of public awareness cam- 
paigns to improve Internet security. The CERT Coordination Center maintains 
a website at http: //www. cert, org where it posts notices of its activities. 


ing the introduction of worms and viruses have been prosecuted. In short, the act 
requires proof that the defendant knowingly caused the transmission of a program or 
data that intentionally caused damage. 

The Computer Fraud and Abuse Act also covers cases involving the theft of infor- 
mation. In particular, the act outlaws obtaining anything of value via the unautho- 
rized access of a computer. Courts have tended to assign a broad interpretation to the 
phrase "anything of value," and thus the Computer Fraud and Abuse Act has been 
applied to more than the theft of information. For instance, courts have ruled that 
the mere use of a computer might constitute "anything of value." 

The right of privacy is another, and perhaps the most controversial, networking 
issue facing the legal community. Questions involving an employer's right to moni- 
tor the communications of employees and the extent to which an Internet service 
provider is authorized to access the information being communicated by its clients 
have been given considerable thought. In the United States, many of these questions 
are addressed by the Electronic Communication Privacy Act (ECPA) of 1986, which 
has its origins in legislation to control wiretapping. Although the act is lengthy, its 
intent is captured in a few short excerpts. In particular, it states that 

Except as otherwise specifically provided in this chapter any person who intentionally 
intercepts, endeavors to intercept, or procures any other person to intercept or endeavor 
to intercept, any wire, oral, or electronic communication . . . shall be punished as pro- 
vided in subsection ( 4 ) or shall be subject to suit as provided in subsection ( 5 ) . 

and 


. .. any person or entity providing an electronic communication service to the public shall 
not intentionally divulge the contents of any communication ... on that service to any 
person or entity other than an addressee or intended recipient of such communication 
or an agent of such addressee or intended recipient. 

In brief, the ECPA confirms an individual's right to private communication, it is ille- 
gal for an Internet service provider to release information about the communication 
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of its clients, and it is illegal for unauthorized personnel to eavesdrop on another's com- 
munication. But the ECPA leaves room for debate. For example, the question regard- 
ing the rights of an employer to monitor the communication of employees becomes 
a question of authorization, which courts have tended to grant to employers when 
the communication is carried out using the employer's equipment. 

Moreover, the act goes on to give some government agencies authority to moni- 
tor electronic communications under certain restrictions. These provisions have been 
the source of much debate. For example, in 2000 the FBI revealed the existence of its 
system, called Carnivore, that reports on the communication of all subscribers of an 
Internet service provider rather than just a court-designated target, and in 2001 in 
response to the terrorist attack on the World Trade Center, congress passed the con- 
troversial USA PATRIOT (Uniting and Strengthening America by Providing Appro- 
priate Tools Required to Intercept and Obstruct Terrorism) Act that modified the 
restrictions under which government agencies must operate. 

In addition to the legal and ethical controversies raised by these developments, 
providing monitoring rights raises some technical problems that are more pertinent 
to our study. One is that to provide these capabilities, a communication system be con- 
structed and programmed so that communications can be monitored. To establish 
such capabilities was the goal of the Communications Assistance for Faw Enforce- 
ment Act (CALEA). It requires telecommunication carriers to modify their equipment 
to accommodate law enforcement taps-a requirement that has been complex and 
expensive to meet. 

Another controversial issue involves the clash between the government's right to 
monitor communications and the public's right to use encryption. If the messages 
being monitored are well encrypted, then tapping the communication is of limited 
value to law enforcement agencies. Governments in the United States, Canada, and 
Europe are considering systems that would require the registration of ciphering keys, 
but such demands are being fought by corporations. After all, due to corporate espi- 
onage it is understandable that requiring the registration of ciphering keys would 
make many law-abiding corporations, as well as citizens, uncomfortable. How secure 
can the registration system be? 

Finally, as a means of recognizing the scope of legal issues surrounding the Inter- 
net, we cite the Anticybersquatting Consumer Protection Act of 1999 that is designed 
to protect organizations from impostors who might otherwise establish look-a-like 
domain names (a practice known as cybersquatting). The act prohibits the use of 
domain names that are identical or confusingly similar to another's trademark or 
"common law trade mark." One effect is that although the act does not outlaw domain 
name speculation (the process of registering potentially desirable domain names 
and later selling the rights to that name), it limits the practice to generic domain 
names. Thus, a domain name speculator might legally register a generic name such 
as GreatUsedCars.com but might not be able to claim rights to the name 
Big AlUsedCars . com if Big A1 is in the used car business. Such distinctions are 
often the subject of debate in law suits based on the Anticybersquatting Consumer 
Protection Act. 
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1. What are two common ways that malware gains access to a. computer systeflfltfif 

2 What distinction is there between the types off fritewalls that can be placed at a 
domain's gateway as opposed to an individual host within the domain? 

3. Technically, the term data refers to representations of information, whereas 

information refers to the underlying meaning. Does the use of passwords protect 
data or information? Does the use of encryption protect data or information? 

4 What advantage does public-key encryption have over more traditional 
encryption techniques? 

5 What problems are associated with legal attempts to protect against network 
security problems? 


Questions 

& Exercises 


Chapter Review Problems 

(Asterisked problems are associated with optional SeCti«cms.) 


1 . What is a protocol? Identify three protocols 
introduced in this chapter and describe the 
purpose of each. 

2. Identify and describe a client/server protocol 
used in everyday life. 

3. Describe the client/server model. 

4. Identify two ways of classifying computer 
networks. 

5. What is the difference between an open net- 
work and a closed network? 

6. Token-based protocols can be used to control 
the right to transmit in networks that do not 
have a ring topology. Design a token-based 
protocol to control the right to transmit in a 
LAN with a bus topology. 

7. Describe the steps followed by a machine that 
wants to transmit a message in a network 
using the CSMA/CD protocol. 

8. How does a hub differ from a repeater? 

9. How does a router differ from such devices as 
repeaters, bridges, and switches? 


1 0. What is the distinction between a network and 
an internet? 

1 1 . Identify two protocols for controlling the right 
to transmit a message in a network. 

1 2. Encode each of the following bit patterns 
using dotted decimal notation. 

a. 000000010000001000000011 

b. 1000000000000000 

c. 0001100000001100 

1 3. What bit pattern is represented by each of the 
following dotted decimal patterns? 

a. 0.0 

b. 25.18.1 

c. 5.12.13.10 

14. Suppose the address of a host on the Internet 
is quoted as 134.48.4.123. What is the 32-bit 
address in hexadecimal notation? 

15. If a domain's network identifier is 192.207.177, 
how many unique IP addresses are available 
for referencing computers within the domain? 
(After you have computed the answer, you 
might conjecture that there might be fewer IP 
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addresses than there are computers in the 
domain, and this is often the case. One solu- 
tion is to allocate IP addresses to machines 
only as they are needed, leading to a dynamic 
allocation system in which IP addresses are 
reassigned on a moment by moment basis as 
the needs within the domain change.) 

16. If a computer's mnemonic Internet address 
was 

batman . bat cave . met r opol i s . gov 

what might you conjecture about the structure 
of the domain containing the machine? 

17. Explain the components of the email address 
kermit S animal s .com 

1 8. In the context of FTP, what is the distinction 

between a "text file" and a "binary file"? 

19. What is the role of a domain's mail server? 

20. Define each of the following: 

a. Name server 

b. Domain 

c. Router 

d. Host 

2 1 . What is the role of a Network Virtual Terminal 

in the telnet protocol? 

22 . Define each of the following: 

a. Hypertext 

b. HTML 

c. Browser 

23. Many "lay-users" of the Internet interchange 
the terms Internet and World Wide Web. To 
what do each of the terms correctly refer? 

24 . When viewing a simple Web document, ask 
your browser to display the source version of 
the document. Then identify the basic struc- 
ture of the document. In particular, identify 
the head and the body of the document and 
list some of the statements you find in each. 

25. Modify the HTML document below so that the 
word "Rover" is linked to the document whose 
URL is 

http://animals.org/pets/dogs.html . 


<html> 

<head> 

<title>Ex amp le</title> 

</head> 

<body> 

<hl>My Pet Dog</hl> 

<p>My dog’s name is Rover. </p> 
</body> 

</html> 

2 6 . Draw a sketch showing how the following 
HTML document would appear when dis- 
played on a computer screen. 

<html> 

<head> 

<title>Ex amp le</title> 

</head> 

<body> 

<hl>My Pet Dog</hl> 

<img src = "Rover. jpg”> 

</body> 

</html> 

27. Using the informal XML style as presented in 
the text, design a markup language for repre- 
senting simple algebraic expressions as text 
files. 

28. Using the informal XML style presented in the 
text, design a set of tags that a word processor 
might use for marking the underlying text. For 
example, how would a word processor indicate 
what text should be bold, italic, underlined, 
etc.? 

29. Using the informal XML style presented in the 
text, design a set of tags that could be used to 
mark motion picture reviews according to the 
way the text items should appear on a printed 
page. Then design a set of tags that could be 
used to mark the reviews according to the 
meaning of the items in the text. 

30 . Using the informal XML style presented in the 
text, design a set of tags that could be used to 
mark articles about sporting events according 
to the way the text items should appear on a 
printed page. Then design a set of tags that 
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could be used to mark the articles according to 
the meaning of the items in the text. 

31 . Identify the components of the following URL 
and describe the meaning of each. 

http://lifeforms.com/animals/ 

movie stars/kermit.html 

32. Identify the components of each of the 
following abbreviated URLs. 

a. http://www.farmtools.org/ 

windmills.html 

b. http://castles.org/ 

c. www.coolstuff.com 

3 3 . How would the action of a browser differ if 

you asked it to "find the document" at the URL 
telnet://stargazer.universe.org 

as opposed to 

http://stargazer.universe.org? 

34. Give two examples of client-side activities on 
the Web. Give two examples of server-side 
activities on the Web. 

*35. Suppose each computer in a ring network is 
programmed to transmit simultaneously in 
both directions those messages that originate 
at that station and are addressed to all the 
other stations belonging to the network. 
Moreover, suppose this is done by first acquir- 
ing access to the communication path to the 
machine's left, retaining this access until 
access to the path to the right is acquired, and 
then transmitting the message. Identify the 
deadlock (see the optional Section 3.4) that 
occurs if all the machines in the network try 
to originate such a message at the same time. 

"36. What is the OSI reference model? 

'37. In a network based on the bus topology, the 
bus is a nonshareable resource for which the 
machines must compete in order to transmit 
messages. How is deadlock (see the optional 
Section 3.4) controlled in this context? 


*38. List the four layers in the Internet software 
hierarchy and identify a task performed by 
each layer. 

*39. Why does the transport layer chop large mes- 
sages into small packets? 

*40. When an application asks the transport layer 
to use TCP to transmit a message, what addi- 
tional messages will be sent by the transport 
layer in order to fulfill the application layer's 
request? 

Ml. In what way could TCP be considered a better 
protocol for implementing the transport layer 
than UDP? In what way could UDPbe consid- 
ered better than TCP? 

*42. What does it mean to say that UDP is a con- 
nectionless protocol? 

"43. At what layer in the TCP/IP protocol hierar- 
chy could a firewall be placed to filter incom- 
ing traffic by means of 

a. message content 

b. source address 

c. type of application 

44. Suppose you wanted to establish a firewall to 
filter out email messages containing certain 
terms and phrases. Would this firewall be 
placed at your domain's gateway or at the 
domain's mail server? Explain your answer. 

45. What is a proxy server and what are its 
benefits? 

46. Summarize the principles of public-key 
encryption. 

47. In what way is an unprotected idle PC a dan- 
ger to the Internet? 

48. In what sense does the global nature of the 
Internet limit legal solutions to Internet 
problems? 
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The following questions are intended as a guide to the ethical/social/legal issues asso- 
ciated with the field of computing. The goal is not merely to answer these questions. 
You should also consider why you answered as you did and whether your justifications 
are consistent from one question to the next. 

1. The ability to connect computers via networks has popularized the concept of 
working at home. What are some pros and cons of this movement? Will it 
affect the consumption of natural resources? Will it strengthen families? Will 
it reduce "office politics"? Will those who work at home have the same career 
advancement opportunities as those who work on site? Will community ties 
be weakened? Will reduced personal contact with peers have a positive or 
negative effect? 

2. Ordering merchandise over the Internet is becoming an alternative to "hands 
on" shopping. What effect will such a shift in shopping habits have on com- 
munities? What about shopping malls? What about small shops, such as book- 
stores and clothing stores, in which you like to browse without buying? To 
what extent is buying at the lowest possible price good or bad? Is there any 
moral obligation to pay more for an item in order to support a local business? 
Is it ethical to compare products at a local store and then order your selection 
at a lower price via the Internet? What are the long-term consequences of 
such behavior? 

3. To what extent should a government control its citizens' access to the Internet 
(or any international network)? What about issues that involve national secu- 
rity? What are some security issues that might occur? 

4 . Electronic bulletin boards allow users of networks to post messages (often 
anonymously) and read messages posted by others. Should the manager of 
such a bulletin board be held responsible for its contents? Should a telephone 
company be held responsible for the contents of telephone conversations? 
Should the manager of a grocery store be held responsible for the contents of 
a community bulletin board located in the store? 

5 . Should the use of the Internet be monitored? Should it be regulated? If so, by 
whom and to what extent? 

6. How much time do you spend using the Internet? Is that time well spent? 

Has Internet access altered your social activities? Do you find it easier to talk 
to people via the Internet than in person? 

7 . When you buy a software package for a personal computer, the developer usu- 
ally asks you to register with the developer so that you can be notified of 
future upgrades. This registration process is increasingly being handled via 
the Internet. You are usually asked to give such things as your name, address, 
and perhaps how you learned of the product, and then the developer's soft- 
ware automatically transfers this data to the developer. What ethical issues 
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would be raised if the developer designed the registration software so that it 
sent additional information to the developer during the registration process? 
For example, the software might scan the contents of your system and report 
the other software packages found. 

8 . When you visit a website, that site has the capability of recording data, called 
cookies, on your computer indicating that you have visited that site. These 
cookies can then be used to identify return visitors and to record their previ- 
ous activities so that future visits to the site can be handled more efficiently. 
The cookies on your computer also provide a record of the sites you have vis- 
ited. Should a website have such the capability to record cookies on your com- 
puter? Should a website be allowed to record cookies on your computer 
without your knowledge? What are possible benefits of cookies? What prob- 
lems could arise from the use of cookies? 

9 . If corporations are required to register their encryption keys with a govern- 
ment agency, will they be safe? 

1 0. in general, etiquette tells us to avoid calling a friend at his or her place of 
work for personal or social matters such as making arrangements for a week- 
end outing. Likewise, most of us would hesitate to call a customer at his or 
her home to describe a new product. In a similar manner, we mail wedding 
invitations to the guests' residences, whereas we mail announcements of busi- 
ness conferences to the attendees' work addresses. Is it proper to send per- 
sonal email to a friend via the mail server at the friend's place of 
employment? 

11 . To what extent should photographs be owned? Suppose a person places his or 
her photograph on a website and someone else downloads that photograph, 
alters it so that the subject is in a compromising situation, and circulates the 
altered version. What recourse should the subject of the photograph have? 

1 2. Suppose a PC owner leaves the PC connected to the Internet where it ulti- 
mately is used by another party to implement a denial of service attack. To 
what extent should the PC owner be liable? Does your answer depend on 
whether the owner installed proper firewalls? 
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Algorithms 


In the introductory chapter we learned 
that the central theme of computer sci- 
ence is the study of algorithms. It is time 
now for us to focus on this core topic. 
Our goal is to explore enough of this 
foundational material so that we can 
truly understand and appreciate the 
science of computing. 
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We have seen that before a computer can perform a task, it must be given an algorithm 
telling it precisely what to do; consequently, the study of algorithms is the cornerstone 
of computer science. In this chapter we introduce many of the fundamental concepts 
of this study, including the issues of algorithm discovery and representation as well as 
the major control concepts of iteration and recursion. In so doing we also present a 
few well-known algorithms for searching and sorting. We begin by reviewing the con- 
cept of an algorithm. 


5.1 The Concept ot an Algorithm 

In the introductory chapter we informally defined an algorithm as a set of steps that 
define how a task is performed. In this section we look more closely at this funda- 
mental concept. 


An Informal Review 

We have encountered a multitude of algorithms in our study. We have found algo- 
rithms for converting numeric representations from one form to another, detecting 
and correcting errors in data, compressing and decompressing data files, control- 
ling time-sharing in a multitasking environment, and many more. Moreover, we 
have seen that the machine cycle that is followed by a CPU is nothing more than 
the simple algorithm 

As long as the halt instruction has not been executed continue to execute the 
following steps: 

a. Fetch an instruction. 

b. Decode the instruction. 

c. Execute the instruction. 

As demonstrated by the algorithm describing a magic trick in Figure 0.1, algo- 
rithms are not restricted to technical activities. Indeed, they underlie even such mun- 
dane activities as shelling peas: 

Obtain a basket of unshelled peas and an empty bowl. 

As long as there are unshelled peas in the basket continue to execute the fol- 
lowing steps: 

a. Take a pea from the basket. 

b. Break open the pea pod. 

c. Dump the peas from the pod into the bowl. 

d. Discard the pod. 

In fact, many researchers believe that every activity of the human mind, includ- 
ing imagination, creativity, and decision making, is actually the result of algo- 
rithm execution-a conjecture we will revisit in our study of artificial intelligence 
(Chapter 10). 

But before we proceed further, let us consider the formal definition of an 
algorithm. 
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The Formal Definition of an Algorithm 

Informal, loosely defined concepts are acceptable and common in everyday life, but 
a science must be based on well-defined terminology. Consider, then, the formal def- 
inition of an algorithm stated in Figure 5.1. 

Note that the definition requires that the set of steps in an algorithm be ordered. 
This means that the steps in an algorithm must have a well-established structure in 
terms of the order of their execution. This does not mean, however, that the steps 
must be executed in a sequence consisting of a first step, followed by a second, and 
so on. Some algorithms, known as parallel algorithms, contain more than one 
sequence of Steps, each designed to be executed by different processors in a multi- 
processor machine. In such cases the overall algorithm does not possess a single 
thread of steps that conforms to the first-step, second-step scenario. Instead, the algo- 
rithm's structure is that of multiple threads that branch and reconnect as different 
processors perform different parts of the overall task. (We will revisit this concept in 
Section 6.6.) Other examples include algorithms executed by circuits such as the flip- 
flop in Section 1.1, in which each gate performs a single step of the overall algorithm. 
Here the steps are ordered by cause and effect, as the action of each gate propagates 
throughout the circuit. 

Next, consider the requirement that an algorithm must consist of executable steps. 
To appreciate this condition, consider the instruction 

Make a list of all the positive integers 

which would be impossible to perform because there ana infinitely many positive 
integers. Thus any set of instructions involving this instruction would not be an algo- 
rithm. Computer scientists use the term effective to capture the concept of being exe- 
cutable. That is, to say that a step is effective means that it is doable. 

Another requirement imposed by the definition in Figure 5.1 is that the steps in 
an algorithm be unambiguous. This means that during execution of an algorithm, the 
information in the state of the process must be sufficient to determine uniquely and 
completely the actions required by each step. In other words, the execution of each 
step in an algorithm does not require creative skills. Rather, it requires only the abil- 
ity to follow directions. (In Chapter 11 we will learn that "algorithms," called nonde- 
terministic algorithms, that do not conform to this restriction are an important topic 
of research.) 

Figure 5.1 The definition of an algorithm 


An algorithm is an ordered set 
of unambiguous, executable steps 
that defines a terminating process. 
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The definition in Figure 5.1 also requires that an algorithm define a terminating 
process, which means that the execution of an algorithm must lead to an end. The ori- 
gin of this requirement is in theoretical computer science, where the goal is to answer 
such questions as "What are the ultimate limitations of algorithms and machines?" 
Here computer science seeks to distinguish between problems whose answers can be 
obtained algorithmically and problems whose answers lie beyond the capabilities of 
algorithmic systems. In this context, a line is drawn between processes that culminate 
with an answer and those that merely proceed forever without producing a result. 

There are, however, meaningful applications for nonterminating processes, 
including monitoring the vital signs of a hospital patient and maintaining an aircraft's 
altitude in flight. Some would argue that these applications involve merely the repe- 
tition of algorithms, each of which reaches an end and then automatically repeats. Oth- 
ers would counter that such arguments are simply attempts to cling to an overly 
restrictive formal definition. In any case, the result is that the term algorithm is often 
used in applied, or informal settings in reference to sets of steps that do not neces- 
sarily define terminating processes. An example is the long-division "algorithm" that 
does not define a terminating process for dividing 1 by 3. Technically, such instances 
represent misuses of the term. 


The Abstract Nature of Algorithms 

It is important to emphasize the distinction between an algorithm and its repre- 
sentation-a distinction that is analogous to that between a story and a book. A 
story is abstract, or conceptual, in nature; a book is a physical representation of a 
story. If a book is translated into another language or republished in a different for- 
mat, it is merely the representation of the story that changes-the story itself 
remains the same. 

In the same manner, an algorithm is abstract and distinct from its representa- 
tion. A single algorithm can be represented in many ways. As an example, the algo- 
rithm for converting temperature readings from Celsius to Fahrenheit is traditionally 
represented as the algebraic formula 

F = (v,)C + 32 

But it could be represented by the instruction 

Multiply the temperature reading in Celsius by % 
and then add 32 to the product 

or even in the form of an electronic circuit. In each case the underlying algorithm is 
the same; only the representations differ. 

The distinction between an algorithm and its representation presents a problem 
when we try to communicate algorithms. A common example involves the level of 
detail at which an algorithm must be described. Among meteorologists, the instruc- 
tion "Convert the Celsius reading to its Fahrenheit equivalent" suffices, but a lay- 
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person, requiring a more detailed description, might argue that the instruction is 
ambiguous. The problem, however, is not with the underlying algorithm but that the 
algorithm is not represented in enough detail for the layperson. In the next section 
we will see how the concept of primitives can be used to eliminate such ambiguity 
problems in an algorithm's representation. 

Finally, while on the subject of algorithms and their representations, we should 
clarify the distinction between two other related concepts-programs and processes. 
A program is a representation of an algorithm. (Here we are using the term algorithm 
in its less formal sense in that many programs are representations of nonterminating 
"algorithms.") In fact, within the computing community the term program usually 
refers to a formal representation of an algorithm designed for computer application. 
We defined a process in Chapter 3 to be the activity of executing a program. Note, how- 
ever, that to execute a program is to execute the algorithm represented by the program, 
so a process could equivalently be defined as the activity of executing an algorithm. 
We conclude that programs, algorithms, and processes are distinct, yet related, enti- 
ties. A program is the representation of an algorithm, whereas a process is the activ- 
ity of executing an algorithm. 


1 . Summarize the distinctions between a process, an algorithm, and a program. 

2. Give some examples of algorithms with which you are familiar. Are they 
really algorithms in the precise sense? 

3. Identify some points of vagueness in our informal definition of an algorithm 
introduced in Section 0.1 of the introductory chapter. 

4. in what sense do the steps described by the following list of instructions fail 
to constitute an algorithm? 

Step 1 . Take a coin out of your pocket and put it on the table. 

Step 2. Return to Step 1 . 


Questions 
& Exercises 


5.2 Algorithm Representation 

In this section we consider issues relating to an algorithm's representation. Our goal 
is to introduce the basic concepts of primitives and pseudocode as well as to establish 
a representation system for our own use. 


Primitives 

The representation of an algorithm requires some form of language. In the case of 
humans this might be a traditional natural language (English, Spanish, Russian, 
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Figure 5.2 Folding a bird from a square piece of paper 



Japanese) or perhaps the language of pictures, as demonstrated in Figure 5.2, which 
describes an algorithm for folding a bird from a square piece of paper. Often, how- 
ever, such natural channels of communication lead to misunderstandings, some- 
times because the terminology used has more than one meaning. (The sentence, 
"Visiting grandchildren can be nerve-racking," could mean either that the grand- 
children cause problems when they come to visit or that going to see them is prob- 
lematic.) Problems also arise over misunderstandings regarding the level of detail 
required. Few readers could successfully fold a bird from the directions given in Fig- 
ure 5.2, yet a student of origami would probably have little difficulty. In short, com- 
munication problems arise when the language used for an algorithm’s representation 
is not precisely defined or when information is not given in adequate detail. 
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Computer science approaches these problems by establishing a well-defined set 
ofbuilding blocks from which algorithm representations can be constructed. Such a 
building block is called a primitive. Assigning precise definitions to these primitives 
removes many problems of ambiguity, and requiring algorithms to be described in 
terms of these primitives establishes a uniform level of detail. A collection of primi- 
tives along with a collection of rules stating how the primitives can be combined to 
represent more complex ideas constitutes a programming language. 

Each primitive consists of two parts: its syntax and its semantics. Syntax refers to 
the primitive's symbolic representation, and semantics refers to the meaning of the 
primitive. The syntax of air consists of three symbols, whereas the semantics is a 
gaseous substance that surrounds the world. As an example. Figure 5.3 presents some 
of the primitives used in origami. 


Figure 5.3 Origami primitives 


Syntax 


Semantics 
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Distinguishes between different sides of paper 


as in 




Represents a valley fold 





Represents a mountain fold 
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Algorithm Representation During Algorithm Design 

The task of designing a complex algorithm requires that the designer keep track 
of numerous interrelated concepts'-a requirement that can exceed the capabili- 
ties of the human mind. (In an article in Psychological Review in 1956, George A. 
Miller reported research indicating that the human mind is capable of manipu- 
lating only about seven details at any one time.) Thus the designer of complex 
algorithms needs a way to record and recall portions of an evolving algorithm 
as his or her concentration requires. 

During the 1950s and 1960s, flowcharts (by which algorithms are repre- 
sented by geometric shapes connected by arrows) was the state-of-the-art design 
tool. However, flowcharts often became tangled webs of crisscrossing arrows that 
made understanding the structure of the underlying algorithm difficult. Thus 
the use of flowcharts as design tools has given way to other representation tech- 
niques. An example is the pseudocode used in this text, by which algorithms are 
represented with well-defined textual structures. Flowcharts are still beneficial 
when the goal is presentation rather than design. For example, Figures 5.8 and 
5.9 apply flowchart notation to demonstrate the algorithmic structure repre- 
sented by popular control statements. 

The search for better design notations is a continuing process. In Chapter 7 
we will see that the trend is to use graphical techniques to assist in the global 
design of large software systems, while pseudocode remains popular for design- 
ing the smaller procedural components within a system. 


To obtain a collection of primitives to use in representing algorithms for com- 
puter execution, we could turn to the individual instructions that the machine is 
designed to execute. If an algorithm is expressed at this level of detail, we will certainly 
have a program suitable for machine execution. However, expressing algorithms at this 
level is tedious, and so one normally uses a collection of "higher-level" primitives, 
each being an abstract tool constructed from the lower-level primitives provided in the 
machine's language. The result is a formal programming language in which algo- 
rithms can be expressed at a conceptually higher level than in machine language. We 
will discuss such programming languages in the next chapter. 


Pseudocode 

For now, we forgo the introduction of a formal programming language in favor of a less 
formal, more intuitive notational system known as pseudocode. In general, a 
pseudocode is a notational system in which ideas can be expressed informally dur- 
ing the algorithm development process. 

One way to obtain a pseudocode is simply to loosen the rules of the formal lan- 
guage in which the final version of the algorithm is to be expressed. This approach is 
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commonly used when the target programming language is known in advance. There 
the pseudocode used during the early stages of program development consists of syn- 
tax-semantic structures similar to, but less formal than, those used in the target pro- 
gramming language. 

Our goal, however, is to consider the issues of algorithm development and rep- 
resentation without confining our discussion to a particular programming language. 
Thus our approach to pseudocode is to develop a consistent, concise notation for rep- 
resenting recurring semantic structures. In turn, these structures will become the 
primitives in which we attempt to express future ideas. 

One such recurring semantic structure is the saving of a computed value. For exam- 
ple, if we have computed the sum of our checking and savings account balances, we may 
want to save the result so we can refer to it later. In such cases, we will use the form 

name <- expression 

where name is the name by which we will refer to the result and expression describes 
the computation whose result is to be saved. We will read these statements as "assign 
name the value of expression, " and we will refer to such statements as assignment 
statements. For example, the statement 

RemainingFunds <- Checking Balance + SavingsBalance 

is an assignment statement that assigns the sum of CheckingBalance and SavingsBal- 
ance to the name RemainingFunds. Thus, the term RemainingFunds can be used in 
future statements to refer to that sum. 

Another recurring semantic structure is the selection of one of two possible activ- 
ities depending on the truth or falseness of some condition. Examples include: 

If the gross domestic product has increased, buy common stock; otherwise, sell 
common stock. 

Buy common stock if the gross domestic product has increased and sell it otherwise. 
Buy or sell common stock depending on whether the gross domestic product has 
increased or decreased, respectively. 

Each of these statements could be rewritten to conform to the structure 

if (condition) then ( activity ) 
else (activity) 

where we have used the key words if, then, and else to announce the different sub- 
structures within the main structure and have used parentheses to delineate the 
boundaries of these substructures. By adopting this syntactic structure for our 
pseudocode, we acquire a uniform way in which to express this common semantic 
structure. Thus, whereas the statement 

Depending on whether or not the year is a leap year, divide the total by 
366 or 365, respectively. 

might possess a more creative literary style, we will consistently opt for the straight- 
forward 
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if (year is leap year) 

then (daily total <- total divided by 366) 
else (daily total <- total divided by 365) 

We also adopt the shorter syntax 

if (condition ) then (activity) 

for those cases not involving an else activity. Using this notation, the statement 
Should it be the case that sales have decreased, lower the price by 5 % . 
will be reduced to 

if (sales have decreased) then (lower the price by 5%) 

Still another common semantic structure is the repeated execution of a statement or 
sequence of statements as long as some condition remains true. Informal examples include 

As long as there are tickets to sell, continue selling tickets. 

and 


while there are tickets to sell, keep selling tickets. 

For such cases, we adopt the uniform pattern 
while (condition) do (activity) 

for our pseudocode. In short, such a statement means to check the condition and, if 
it is true, perform the activity and return to check the condition again. If, however, the 
condition is found to be false, move on to the next instruction following the while 
structure. Thus both of the preceding statements are reduced to 

while (tickets remain to be sold) do (sell a ticket) 

Indentation often enhances the readability of a program. For example, the statement 

if (not raining) 

then (if (temperature = hot) 
then (go swimming) 
else (play golf) 

) 

else (watch television) 

is easier to comprehend than the otherwise equivalent 

if (not raining) then (if (temperature = hot) then (go swimming) 
else (play golf)) else (watch television) 

Thus we will adopt the use of indentation in our pseudocode. (Note that we can 
even use indentation to align a closing parenthesis directly below its partner to 
simplify the process of identifying the scope of statements or phrases.) 

We want to use our pseudocode to describe activities that can be used as abstract 
tools in other applications. Computer science has a variety of terms for such program 
units, including subprogram, subroutine, procedure, module, and function, each with 
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its own variation of meaning. We will adopt the term procedure for our pseudocode 
and use this term to announce the title by which the pseudocode unit will be known. 
More precisely, we will begin a pseudocode unit with a statement of the form 

procedur Qname 

where name is the particular name of the unit. We will then follow this introductory 
statement with the statements that define the unit's action. For example. Figure 5.4 
is a pseudocode representation of a procedure called Greetings that prints the message 
"Hello" three times. 

When the task performed by a procedure is required elsewhere in our pseudocode, 
we will merely request it by name. For example, if two procedures were named 
ProcessLoan and RejectApplication, then we could request their services within an if- 
then -else structure by writing 

if (. . .) then (Execute the procedure ProcessLoan) 

else (Execute the procedure RejectApplication) 

which would result in the execution of the procedure ProcessLoan if the tested 
condition were true or in the execution of RejectApplication if the condition were false. 

If procedures are to be used in different situations, they should be designed to be 
as generic as possible. A procedure for sorting lists of names should be designed to sort 
any list- not a particular list- so it should be written in such a way that the list to be 
sorted is not specified in the procedure itself. Instead, the list should be referred to 
by a generic name within the procedure's representation. 

In our pseudocode, we will adopt the convention of listing these generic names 
(which are called parameters) in parentheses on the same line on which we identify 
the procedure's name. In particular, a procedure named Son, which is designed to 
sort any list of names, would begin with the statement 

procedure Sort (List) 

Later in the representation where a reference to the list being sorted is required, 
the generic name List would be used. In turn, when the services of Sort are 
required, we will identify which list Is to be substituted for List in the procedure 
Sort. Thus we will write something such as 

Apply the procedure Sort to the organization's membership list 

and 

Figure 5.4 The procedure Greetings in pseudocode 


procedure Greetings 

Count <- 3; 

while (Count > 0) do 

(print the message "Hello" and 
Count <- Count -1 ) 
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Naming Items in Programs 

In a natural language, items often have multiword names such as "cost of produc- 
ing a widget" or "estimated arrival time." Experience has shown that use of such 
multiword names in the representation of an algorithm can complicate the algo- 
rithm's description. It is better to have each item identified by a single contiguous 
block of text. Over the years many techniques have been used to compress multi- 
ple words into a single lexical unit to obtain descriptive names for items in pro- 
grams. One is to use underlines to connect words, producing names such as 
estimated_arrival_time. Another is to use uppercase letters to help a reader 
comprehend a compressed multiword name. For example, one could start each 
word with an uppercase letter to obtain names such as EstimatedArrivalTime. 
This technique is called Pascal casing, because it was popularized by users of the 
Pascal programming language. A variation of Pascal casing is called camel casing, 
which is identical to Pascal casing except that the first letter remains in lowercase 
asinestimatedArrivalTime. In this text we lean toward Pascal casing, but the 
choice is largely a matter of taste. 


Apply the procedure Sort to the wedding guest list 
depending on our needs. 

Keep in mind that the purpose of our pseudocode is to provide a means of rep- 
resenting algorithms in a readable, informal manner. We want a notational system 
that will assist us in expressing our ideas-not enslave us to rigorous, formal rules. 
Thus we will feel free to expand or modify our pseudocode when needed. In partic- 
ular, if the statements within a set of parentheses involve parenthetical statements 
themselves, it can become difficult to pair opening and closing parenthesis visually. 
In these cases, many people find it helpful to follow a closing parenthesis with a short 
comment explaining which statement or phrase is being terminated. In particular, 
one might follow the final parenthesis in a while statement with the words end while, 
producing a statement such as 

while (...) do 

( . 


) end while 


or perhaps 

while (...) do 

(if (-) 

then ( . 


) end if 
) end while 
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where we have indicated the end of both the if and while statements. 

The point is that we are trying to express an algorithm in a readable form, and thus 
we introduce visual aids (Indentation, comments, etc.) at times to achieve this goal. 
Moreover, if we encounter a recurring theme that is not yet incorporated in our 
pseudocode, we might choose to extend our pseudocode by adopting a consistent syn- 
tax for representing the new concept. 


1. A primitvveiniDnoneonctONtaxitiuhiigihtntiamlitcDbC Ha ctoPQsitom^DBitBitbf'.spbiimitives in Questions 

another. For instance, our while statement is a primitive in our pseudocode, & Exercises 

yet it is ultimately implemented as a composite of machine-language instruc- 
tions. Give two examples of this phenomenon in a noncomputer setting. 

2. In what sense is the construction of procedures the construction of primitives? 

3 The Euclidean algorithm finds the greatest common divisor of two positive 
integers Xand Yby the following process: 

As long as the value of neither X nor Fis zero, continue dividing the larger of 
the values by the smaller and assigning Xand /the values of the divisor and 
remainder, respectively. (The final value ofXis the greatest common divisor.) 

Express this algorithm in our pseudocode. 

4. Describe a collection of primitives that are used in a subject other than com- 
puter programming. 


5.3 Algorithm Discovery 

The development of a program consists of two activities-discovering the underlying 
algorithm and representing that algorithm as a program. Up to this point we have 
been concerned with the issues of algorithm representation without considering the 
question ofhow algorithms are discovered in the first place. Yet algorithm discovery 
is usually the more challenging step in the software development process. After all, 
discovering an algorithm to solve a problem requires finding a method of solving that 
problem. Thus, to understand how algorithms are discovered is to understand the 
problem-solving process. 

The Art of Problem Solving 

The techniques of problem solving and the need to learn more about them are not 
unique to computer science but rather are topics pertinent to almost any field. The close 
association between the process of algorithm discovery and that of general problem 
solving has caused computer scientists to join with those of other disciplines in the 
search for better problem-solving techniques. Ultimately, one would like to reduce the 
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process of problem solving to an algorithm in itself, but this has been shown to be impos- 
sible. (This is a result of the material in Chapter 11, where we will show that there are 
problems that do not have algorithmic solutions.) Thus the ability to solve problems 
remains more of an artistic skill to be developed than a precise science to be learned. 

As evidence of the elusive, artistic nature of problem solving, the following loosely 
defined problem-solving phases presented by the mathematician G. Polya in 1945 
remain the basic principles on which many attempts to teach problem-solving skills 
are based today. 

Phase I. Understand the problem. 

Phase 2. Devise a plan for solving the problem. 

Phase 3. Carry out the plan. 

Phase 4. Evaluate the solution for accuracy and for its potential as a tool for 
solving other problems. 

Translated into the context of program development, these phases become 

Phase 1. Understand the problem. 

Phase 2. Get an idea of how an algorithmic procedure might solve the problem. 

Phase 3. Formulate the algorithm and represent it as a program. 

Phase 4. Evaluate the program for accuracy and for its potential as a tool for 
solving other problems. 

Having presented Polya's list, we should emphasize that these phases are not 
steps to be followed when trying to solve a problem but rather phases that will be 
completed sometime during the solution process. The key word here is followed. You 
do not solve problems by following. Rather, to solve a problem, you must take the ini- 
tiative and lead. If you approach the task of solving a problem in the frame of mind 
depicted by "Now I've finished Phase 1, it's time to move on to Phase 2," you are not 
likely to be successful. However, if you become involved with the problem and ulti- 
mately solve it, you most likely can lookback at what you did and realize that you per- 
formed Polya's phases. 

Another important observation is that Polya's phases are not necessarily com- 
pleted in sequence. Successful problem solvers often start formulating strategies for 
solving a problem (Phase 2) before the problem itself is entirely understood (Phase 1). 
Then, if these strategies fail (during Phases 3 or 4), the potential problem solver gains 
a deeper understanding of the intricacies of the problem and, with this deeper under- 
standing, can return to form other and hopefully more successful strategies. 

Keep in mind that we are discussing how problems are solved-not how we would 
like them to be solved. Ideally, we would like to eliminate the waste inherent in the 
trial -and- error process just described. In the case of developing large software sys- 
tems, discovering a misunderstanding as late as Phase 4 can represent a tremendous 
loss in resources. Avoiding such catastrophes is a major goal of software engineers 
(Chapter 6), who have traditionally insisted on a thorough understanding of a prob- 
lem before proceeding with a solution. One could argue, however, that a true under- 
standing of a problem is not obtained until a solution has been found. The mere fact 
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that a problem is unsolved implies a lack of understanding. To insist on a complete 
understanding of the problem before proposing any solutions is therefore somewhat 
idealistic. 

As an example, consider the following problem: 


Person A is charged with the task of determining the ages of person B's three chil- 
dren. B tells A that the product of the children's ages is 36. After considering this clue, 
A replies that another clue is required, so B tells A the sum of the children's ages. 
Again, A replies that another clue is needed, so B tells A that the oldest child plays the 
piano. After hearing this clue, A tells B the ages of the three children. 

How old are the three children? 


At first glance the last clue seems to be totally unrelated to the problem, yet it is appar- 
ently this clue that allows A to finally determine the ages of the children. How can 
this be? Let us proceed by formulating a plan of attack and following this plan, even 
though we still have many questions about the problem. Our plan will be to trace the 
steps described by the problem statement while keeping track of the information 
available to person A as the story progresses. 

The first clue given A is that the product of the children's ages is 36. This means 
that the triple representing the three ages is one of those listed in Figure 5.5(a). The 
next clue is the sum of the desired triple. We are not told what this sum is, but we are 
told that this information is not enough for A to isolate the correct triple; therefore the 
desired triple must be one whose sum appears at least twice in the table of Figure 
5.5(b). But the only triples appearing in Figure 5.5(b) with identical sums are (1,6,6) 
and (2,2,9), both of which produce the sum 13. This is the information available to A 
at the time the last clue is given. It is at this point that we finally understand the sig- 
nificance of the last clue. It has nothing to do with playing the piano; rather it is the 
fact that there is an oldest child. This rules out the triple (1,6,6) and thus allows us to 
conclude that the children's ages are 2, 2, and 9. 

In this case, then, it is not until we attempt to implement our plan for solving the 
problem (Phase 3) that we gain a complete understanding of the problem (Phase 1). Had 
we insisted on completing Phase 1 before proceeding, we would probably never have 
found the children's ages. Such irregularities in the problem-solving process are fun- 
damental to the difficulties in developing systematic approaches to problem solving. 


Figure 5.5 


a. Triples whose product is 36 


b. Sums of triples from part (a) 


(1,1,36) (1,6,6) 
(1,2,18) (2,2,9) 
(1,3,12) (2,3,6) 
(1,4,9) (3,3,4) 


1 +3+12=16 


1 +4 + 9=14 


1 +1 +36=38 


1 + 2 + 18 = 21 


2 + 3 + 6 = 11 

3 + 3 + 4 = 10 


2+2 + 9=13 


1+6 + 6=13 
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Another irregularity is the mysterious inspiration that might come to a potential 
problem solver who, having worked on a problem without apparent success, at a later 
time suddenly sees the solution while doing another task. This phenomenon was 
identified by H. von Helmholtz as early as 1896 and was discussed by the mathe- 
matician Henri Poincare' in a lecture before the Psychological Society in Paris. There, 
Poincare described his experiences of realizing the solution to a problem he had 
worked on after he had set it aside and begun other projects. The phenomenon reflects 
a process in which a subconscious part of the mind appears to continue working and, 
if successful, forces the solution into the conscious mind. Today, the period between 
conscious work on a problem and the sudden inspiration is known as an incubation 
period, and its understanding remains a goal of current research. 


Getting a Foot in the Door 

We have been discussing problem solving from a somewhat philosophical point of 
view while avoiding a direct confrontation with the question of how we should go 
about trying to solve a problem. There are, of course, numerous problem-solving 
approaches, each of which can be successful in certain settings. We will identify some 
of them shortly. For now, we note that there seems to be a common thread running 
through these techniques, which simply stated is "get your foot in the door." As an 
example, let us consider the following simple problem: 

Before A, B, C, and D ran a race they made the following predictions: 

A predicted that B would win. 

B predicted that D would be last. 

C predicted that A would be third. 

D predicted that A’s prediction would be correct. 

Only one of these predictions was true, and this was the prediction made by the win- 
ner. In what order did A, B, C, and D Finish the race? 

After reading the problem and analyzing the data, it should not take long to realize 
that since the predictions of A and D were equivalent and only one prediction was 
true, the predictions of both A and D must be false. Thus neither A nor D were 
winners. At this point we have our foot in the door, and obtaining the complete 
solution to our problem is merely a matter of extending our knowledge from here. 
If A's prediction was false, then B did not win either. The only remaining choice for 
the winner is C. Thus, C won the race, and C's prediction was true. Consequently, 
we know that A came in third. That means that the finishing order was either 
CBAD or CDAB. But the former is ruled out because B's prediction must be false. 
Therefore the finishing order was CDAB. 

Of course, being told to get our foot in the door is not the same as being told how 
to do it. Obtaining this toehold, as well as realizing how to expand this initial thrust 
into a complete solution to the problem, requires creative input from the would-be 
problem solver. There are, however, several general approaches that have been pro- 


5.3 Algorithm Discovery 


227 


posed by Polya and others for how one might go about getting a foot in the door. One 
is to try working the problem backward. For instance, if the problem is to find a way 
of producing a particular output from a given input, one might start with that output 
and attempt to back up to the given input. This approach is typical of people trying 
to discover the bird-folding algorithm in the previous section. They tend to unfold a 
completed bird in an attempt to see how it is constructed. 

Another general problem-solving approach is to look for a related problem that 
is either easier to solve or has been solved before and then try to apply its solution to 
the current problem. This technique is of particular value in the context of program 
development. Generally, program development is not the process of solving a par- 
ticular instance of a problem but rather of finding a general algorithm that can be 
used to solve all instances of the problem. More precisely, if we were faced with the 
task of developing a program for alphabetizing lists of names, our task would not be 
to sort a particular list but to find a general algorithm that could be used to sort any 
list of names. Thus, although the instructions 

Interchange the names David and Alice. 

Move the name Carol to the position between Alice and David. 

Move the name Bob to the position between Alice and Carol. 

correctly sort the list David, Alice, Carol, and Bob, they do not constitute the general- 
purpose algorithm we desire. What we need is an algorithm that can sort this list as 
well as other lists we might encounter. This is not to say that our solution for sort- 
ing a particular list is totally worthless in our search for a gen era! -purpose algorithm. 
We might, for instance, get our foot in the door by considering such special cases in 
an attempt to find general principles that can in turn be used to develop the desired 
general-purpose algorithm. In this case, then, our solution is obtained by the tech- 
nique of solving a collection of related problems. 

Still another approach to getting a foot in the door is to apply stepwise refine- 
ment, which is essentially the technique of not trying to conquer an entire task (in 
all its detail) at once. Rather, stepwise refinement proposes that one first view the 
problem at hand in terms of several subproblems. The idea is that by breaking the orig- 
inal problem into subproblems, one is able to approach the overall solution in terms 
of steps, each of which is easier to solve than the entire original problem. In turn, 
stepwise refinement proposes that these steps be decomposed into smaller steps and 
these smaller steps be broken into still smaller ones until the entire problem has been 
reduced to a collection of easily solved subproblems. 

In this light, stepwise refinement is a top-down methodology in that it pro- 
gresses from the general to the specific. In contrast, a bottom-up methodology pro- 
gresses from the specific to the general. Although contrasting in theory, the two 
approaches often complement each other in creative problem solving. The decom- 
position of a problem proposed by the top-down methodology of stepwise refinement 
is often guided by the problem solver's intuition, which might be working in a bottom- 
up mode. 

The top-down methodology of stepwise refinement is essentially an organiza- 
tional tool whose problem-solving attributes are consequences of this organization. It 
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has long been an important design methodology in the data processing community, 
where the development of large software systems encompasses a significant organi- 
zational component. But, as we will learn in Chapter 7, large software systems are 
increasingly being constructed by combining prefabricated components-an approach 
that is inherently bottom-up. Thus, both top-down and bottom-up methodologies 
remain important tools in computer science. 

The importance of maintaining such a broad perspective is exemplified by the fact 
that bringing preconceived notions and preselected tools to the problem-solving task 
can sometimes mask a problem's simplicity. The ages-of-the-children problem dis- 
cussed earlier in this section is an excellent example of this phenomenon. Students 
of algebra invariably approach the problem as a system of simultaneous equations, an 
approach that leads to a dead end and often traps the would-be problem solver into 
believing that the information given is not sufficient to solve the problem. 

Another example is the following: 

As you step from a pier into a boat, your hat falls into the water, unbeknownst to you. 
The river is flowing at 2.5 miles per hour so your hat begins to float downstream. In 
the meantime, you begin traveling upstream in the boat at a speed of 4.75 miles per 
hour relative to the water. After 10 minutes you realize that your hat is missing, turn 
the boat around, and begin to chase your hat down the river. How long will it take to 
catch up with your hat? 

Most algebra students as well as calculator enthusiasts approach this problem by first 
determining how far upstream the boat will have traveled in 10 minutes as well as how 
far downstream the hat will have traveled during that same time. Then, they deter- 
mine how long it will take for the boat to travel downstream to this position. But, 
when the boat reaches this position, the hat will have floated farther downstream. 
Thus, the problem solver either begins to apply techniques of the calculus or becomes 
trapped in a cycle of computing where the hat will be each time the boat goes to 
where the hat was. 

The problem is much simpler than this, however. The trick is to resist the urge 
to begin writing formulas and making calculations. Instead, we need to put these 
skills aside and adjust our perspective. The entire problem takes place in the river. 
The fact that the water is moving in relation to the shore is irrelevant. Think of the 
same problem posed on a large conveyer belt instead of a river. First, solve the prob- 
lem with the conveyer belt at rest. If you place your hat at your feet while stand- 
ing on the belt and then walk away from your hat for 10 minutes, it will take 10 
minutes to return to your hat. Now turn on the conveyer belt. This means that the 
scenery will begin to move past the belt, but, because you are on the belt, this does 
not change your relationship to the belt or your hat. It will still take 10 minutes to 
return to your hat. 

We conclude that algorithm discovery remains a challenging art that must be 
developed over a period of time rather than taught as a subject consisting of well- 
defined methodologies. Indeed, to train a potential problem solver to follow certain 
methodologies is to quash those creative skills that should instead be nurtured. 
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i.. a* Find an algorithm for solving the following pnfiteleinMt: Givem a p*»sMive inte- 
ger n, find the list of positive integers whose product is the largest among 
all the lists of positive integers whose sum is n. For example, if n is 4, the 
desired list is 2, 2 because 2 X 2 is larger than 1 X 1 X 1 X 1 , 2X1X1, 
and 3 x 1. If n is 5, the desired list is 2, 3. 

b. What is the desired list if n = 2001? 

c. Explain how you got your foot in the door. 

2. a. Suppose we are given a checkerboard consisting of 2" rows and 2" columns 

of squares, for some positive integer n, and a box ofL-shaped tiles, each of 
which can cover exactly three squares on the board. If any single square is 
cut out of the board, can we cover the remaining board with tiles such that 
tiles do not overlap or hang off the edge of the board? 

b. Explain how your solution to (a) can be used’ to show that 2 2 " - 1 is divisible 
by 3 for all positive integers n. 

c. How are (a) and fb) reLated to iplh&ses of problem solving? 

3. Decode the following message, then explain how you got your foot in the door. 

Pdco eopdayknnayp wjosan. 

4. Would you be following a top-down methodology if you attempted to solve a 
picture puzzle merely by pouring the pieces out on a table and trying to piece 
them together? Would your answer change if you looked at the puzzle box to 
see what the entire picture was supposed to look like? 


5.4 Iterative Structures 

Our goal now is to study some of the repetitive structures used in describing algo- 
rithmic processes. In this section we discuss iterative structures in which a collec- 
tion of instructions is repeated in a looping manner. In the next section we will 
introduce the technique of recursion. As a side effect, we will introduce some popu- 
lar algorithms-the sequential search, the binary search, and the insertion sort. We 
begin by introducing the sequential search algorithm. 

The Sequential Search Algorithm 

Consider the problem of searching within a list for the occurrence of a particular target 
value. We want to develop an algorithm that determines whether that value is in the list. 
If the value is in the list, we consider the search a success; otherwise we consider it a 
failure. We assume that the list is sorted according to some rule for ordering its entries. 
For example, if the list is a list of names, we assume the names appear in alphabetical 
order, or if the list consists of numeric values, we assume its entries appear in order of 
increasing magnitude. 
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Iterative Structures in Music 

Musicians were using and programming iterative structures centuries before 
computer scientists. Indeed, the structure of a song (being composed of multi- 
pie verses, each followed by the chorus) is exemplified by the while statement 

while (there is a verse remaining) do 
(sing the next verse; 
sing the chorus) 

Moreover, the notation 


*2 





• 

• 


Passage 

• 






is merely a composer's way of expressing the structure 
N <— 1; 

while (N < 3) do 
(play the passage; 
play the Nth ending; 

N < - N + 1) 


To get our foot in the door, we imagine how we might search a guest list of per- 
haps 20 entries for a particular name. In this setting we might scan the list from its 
beginning, comparing each entry with the target name. If we find the target name, the 
search terminates as a success. However, if we reach the end of the list without find- 
ing the target value, our search terminates as a failure. In fact, if we reach a name 
greater than (alphabetically) the target name without finding the target, our search ter- 
minates as a failure. (Remember, the list is arranged in alphabetical order, so reach- 
ing a name greater than the target name indicates that the target does not appear in 
the list.) In summary, our rough idea is to continue searching down the list as long 
as there are more names to be investigated and the target name is greater than the 
name currently being considered. 

In our pseudocode this process can be represented as 

Select the first entry in the list as TestEntry. 
while (TargetValue > TestEntry and 

there remain entries to be considered) 
do (Select the next entry in the list as TestEntry) 

Upon terminating this while structure, one of two conditions will be true: either the 
target value has been found or the target value is not in the list. In either case we can 
detect a successful search by comparing the test entry to the target value. If they are 
equal, the search has been successful. Thus we add the statement 
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if (TargetValue = TestEntry) 
then (Declare the search a success.) 
else (Declare the search a failure.) 

to the end of our pseudocode routine. 

Finally, we observe that the first statement in our routine, which selects the first 
entry in the list as the test entry, is based on the assumption that the list in question 
contains at least one entry. We might reason that this is a safe guess, but just to be sure, 
we can position our routine as the else option of the statement 

if (List empty) 

then (Declare search a failure.) 
else (...) 

This produces the procedure shown in Figure 5.6. Note that this procedure can be 
used from within other procedures by using statements such as 

Apply the procedure Search to the passenger list 
using Darrel Baker as the target value. 

to find out if Darrel Baker is a passenger and 

Apply the procedure Search to the list of ingredients 
using nutmeg as the target value. 

to find out if nutmeg appears in the list of ingredients. 

In summary, the algorithm represented by Figure 5.6 considers the entries in 
the sequential order in which they occur in the list. For this reason, the algorithm 
is called the sequential search algorithm. Because of its simplicity, it is often 
used for short lists or when other concerns dictate its use. However, in the case of 
long lists, sequential searches are not as efficient as other techniques (as we shall 
soon see). 


Figure 5.6 The sequential search algorithm in pseudocode 


procedure Search (List, TargetValue) 
if (List empty) 
then 

(Declare search a failure) 
else 

(Select the first entry in List to be TestEntry; 
while (TargetValue > TestEntry and 

there remain entries to be considered) 
do (Select the next entry in List as TestEntry.); 
if (TargetValue = TestEntry) 

then (Declare search a success.) 
else (Declare search a failure.) 

) end if 
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Loop Control 

The repetitive use of an instruction or sequence of instructions is an important algo- 
rithmic concept. One method of implementing such repetition is the iterative struc- 
ture known as the loop, in which a collection of instructions, called the body of the 
loop, is executed in a repetitive fashion under the direction of some control process. 
A typical example is found in the sequential search algorithm represented in Figure 
5.6. Here we use a while statement to control the repetition of the single statement 
Select the next entry in List as the TestEntry. Indeed, the while statement 

while ( condition ) do (body) 

exemplifies the concept of a loop structure in that its execution traces the cyclic 
pattern 


check the condition. 
execute the body. 
check the condition. 
execute the body. 


check the condition. 
until the condition fails. 

As a general rule, the use of a loop structure produces a higher degree of flexibility 
than would be obtained merely by explicitly writing the body several times. For exam- 
ple, to execute the statement 

Add a drop of sulfuric acid. 

three times, we could write: 

Add a drop of sulfuric acid. 

Add a drop of sulfuric acid. 

Add a drop of sulfuric acid. 

But we cannot produce a similar sequence that is equivalent to the loop structure 

while (the pH level is greater than 4} do 
(add a drop of sulfuric acid) 

because we do not know in advance how many drops of acid will be required. 

Let us now take a closer look at the composition of loop control. You might be 
tempted to view this part of a loop structure as having minor importance. After all, it 
is typically the body of the loop that actually performs the task at hand (for example, 
adding drops ofacid)-fhe control activities appear merely as the overhead involved 
because we chose to execute the body in a repetitive fashion. However, experience has 
shown that the control of a loop is the more error-prone part of the structure and 
therefore deserves our attention. 

The control of a loop consists of the three activities initialize, test, and modify 
(Figure 5.7), with the presence of each being required for successful loop control. The 
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F i g u r e 5 . 7 Components of repetitive control 


Initialize: Establish an initial state thatwill be modified toward the 

termination condition 

Test: Compare the currentstate to the termination condition 

and terminate the repetition if equal 

Modify: Change the state in such a way that it moves toward the 

termination condition 


test activity has the obligation of causing the termination of the looping process by 
watching for a condition that indicates termination should take place. This condition 
is known as the termination condition. It is for the purpose of this test activity that 
we provide a condition within each while statement of our pseudocode. In the case of 
the while statement, however, the condition stated is the condition under which the 
body of the loop should be executed-the termination condition is the negation of the 
condition appearing in the while structure. Thus, in the statement 

while (the pH level is greater than 4) do 
(add a drop of sulfuric acid) 

the termination condition is "the pH level is not greater than 4," and in the while 
statement of Figure 5.6, the termination condition could be stated as 

(TargetValue =s TestEntry) or (there are no more entries to be considered) 

The other two activities in the loop control ensure that the termination condition 
will ultimately occur. The initialization step establishes a starting condition, and the 
modification step moves this condition toward the termination condition. For instance, 
in Figure 5.6, initialization takes place in the statement preceding the while state- 
ment, where the current test entry is established as the first list entry. The modifi- 
cation step in this case is actually accomplished within the loop body, where our 
position of interest (identified by the test entry) is moved toward the end of the list. 
Thus, having executed the initialization step, repeated application of the modifica- 
tion step results in the termination condition being reached. (Either we will reach a 
test entry that is greater than or equal to the target value or we ultimately reach the 
end of the list.) 

We should emphasize that the initialization and modification steps must lead to 
the appropriate termination condition. This characteristic is critical for proper loop 
control, and thus one should always double-check for its presence when designing a 
loop structure. Failure to make such an evaluation can lead to errors even in the sim- 
plest cases. A typical example is found in the statements 

Number < - 1 ; 

while (Number * 6) do 
(Number <- Number + 2) 



234 


Algorithms 


Here the termination condition is "Number = 6." But the value of Number is 
initialized at 1 and then incremented by 2 in the modification step. Thus, as the 
loop cycles, the values assigned to Number will be 1, 3, 5, 7, 9, and so on, but never 
the value 6. In turn, the loop will never terminate. 

The order in which the components of loop control are executed can have subtle 
consequences. In fact, there are two common loop structures that differ merely in this 
regard. The first is exemplified by our pseudocode statement 

while ( condition ) do (activity) 

whose semantics are represented in Figure 5.8 in the form of a flowchart. (Such 
charts use various shapes to represent individual steps and use arrows to indicate 
the order of the steps. The distinction between the shapes indicates the type of 
action involved in the associated step. A diamond indicates a decision and a 
rectangle indicates an arbitrary statement or sequence of statements.) Note that the 
test for termination in the while structure occurs before the loop's body is executed. 

In contrast, the structure in Figure 5.9 requests that the body of the loop be exe- 
cuted before the test for termination is performed. In this case, the loop's body is 
always performed at least once, whereas in the while structure, the body is never exe- 
cuted if the termination condition is satisfied the first time it is tested. 

We will use the syntactic form 

repeat ( activity ) until (condition) 

in our pseudocode to represent the structure shown in Figure 5.9. Thus, the statement 

repeat (take a coin from your pocket) 
until (there are no coins in your pocket) 


Figure 5.8 The while loop structure 
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F i g u r e 5 . 9 The repeat loop structure 


1 


Condition 

false 


Activity 


I 


Test 

condition 


i Condition 
true 


assumes there is a coin in your pocket at the beginning, but 

while (there is a coin in your pocket) do 
(take a coin from your pocket) 


does not. 

Following the terminology of our pseudocode, we will usually refer to these struc- 
tures as the while loop structure or the repeat loop structure. In a more generic con- 
text you might hear the while loop structure referred to as a pretest loop (since the 
test for termination is performed before the body is executed) and the repeat loop 
structure referred to as a posttest loop (since the test for termination is performed 
after the body is executed). 

The Insertion Sort Algorithm 

As an additional example of using iterative structures, let us consider the problem of 
sorting a list of names into alphabetical order. But before proceeding, we should iden- 
tify the constraints under which we will work. Simply stated, our goal is to sort the 
list "within itself." In other words, we want to sort the list by shuffling its entries as 
opposed to moving the list to another location. Our situation is analogous to the prob- 
lem of sorting a list whose entries are recorded on separate index cards spread out on 
a crowded desktop. We have cleared off enough space for the cards but are not allowed 
to push additional materials back to make more room. This restriction is typical in 
computer applications, not because the workspace within the machine is necessarily 
crowded like our desktop, but simply because we want to use the storage space avail- 
able in an efficient manner. 
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Let us get a foot in the door by considering how we might sort the names on the 
desktop. Consider the list of names 

Fred 

Alex 

Diana 

Byron 

Carol 

One approach to sorting this list is to note that the sublist consisting of only the top 
name, Fred, is sorted but the sublist consisting of the top two names, Fred and Alex, 
is not. Thus we might pick up the card containing the name Alex, slide the name 
Fred down into the space where Alex was, and then place the name Alex in the 
hole at the top of the list, as represented by the first row in Figure 5.10. At this 
point our list would be 

Alex 

Fred 

Diana 

Byron 

Carol 

Now the top two names form a sorted sublist, but the top three do not. Thus we 
might pick up the third name, Diana, slide the name Fred down into the hole 
where Diana was, and then insert Diana in the hole left by Fred, as summarized in 
the second row of Figure 5.10. The top three entries in the list would now be 
sorted. Continuing in this fashion, we could obtain a list in which the top four 
entries are sorted by picking up the fourth name, Byron, sliding the names Fred 
and Diana down, and then inserting Byron in the hole (see the third row of Figure 
5.10). Finally, we can complete the sorting process by picking up Carol, sliding Fred 
and Diana down, and then inserting Carol in the remaining hole (see the fourth 
row of Figure 5.10). 

Having analyzed the process of sorting a particular list, our task now is to gen- 
eralize this process to obtain an algorithm for sorting general lists. To this end, we 
observe that each row of Figure 5.10 represents the same general process: Pick up 
the first name in the unsorted portion of the list, slide the names greater than the 
extracted name down, and insert the extracted name back in the list where the hole 
appears. If we identify the extracted name as the pivot entry, this process can be 
expressed in our pseudocode as 

Move the pivot entry to a temporary location leaving a hole in List; 
while (there is a name above the hole and 

that name is greater than the pivot) do 
(move the name above the hole down into the hole 
leaving a hole above the name) 

Move the pivot entry into the hole in List. 

Next, we observe that this process should be executed repeatedly. To begin the 
sorting process, the pivot should be the second entry in the list and then, before 
each additional execution, the pivot selection should be one more entry down the 
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Figure 5.10 Sorting the list Fred, Alex, Diana, Byron, and Carol alphabetically 



Sorted list: 


Alex 


Byron 


Carol 


Diana 


Fred 


list until the last entry has been positioned. That is, as the preceding routine is 
repeated, the initial position of the pivot entry should advance from the second 
entry to the third, then to the fourth, etc., until the routine has positioned the last 
entry in the list. Following this lead we can control the required repetition with 
the statements 
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N <— 2; 

while (the value of N does not exceed the length of List) do 
(Select the Nth entry in List as the pivot entry; 


n Vn + ij 

where N represents the position to use for the pivot entry, the length of List refers 
to the number of entries in the list, and the dots indicate the location where the 
previous routine should be placed. 

Our complete pseudocode program is shown in Figure 5.11. In short, the program 
sorts a list by repeatedly removing an entry and inserting it into its proper place. It 
is because of this repeated insertion process that the underlying algorithm is called 
the insertion sort. 

Note that the structure of Figure 5.1 1 is that of a loop within a loop, the outer 
loop being expressed by the first while statement and the inner loop represented by 
the second while statement. Each execution of the body of the outer loop results in the 
inner loop being initialized and executed until its termination condition is obtained. 
Thus, a single execution of the outer loop's body will result in several executions of 
the inner loop's body. 

The initialization component of the outer loop's control consists of establishing 
the initial value of N with the statement 

N <— 2; 

The modification component is handled by incrementing the value ofN at the end of 
the loop's body with the statement 

N <- N + 1 

The termination condition occurs when the value of N exceeds the length of the list. 

The inner loop's control is initialized by removing the pivot entry from the list and 
thus creating a hole. The loop's modification step is accomplished by moving entries 


Figure 5.11 The insertion sort algorithm expressed in pseudocode 


procedure Sort (List) 

N <- 2; 

while (the value of N does not exceed the length of List) do 
(Select the Nth entry in List as the pivot entry; 

Move the pivot entry to a temporary location leaving a hole in List; 

while (there is a name above the hole and that name is greater than the pivot) do 

(move the name above the hole down into the hole leaving a hole above the name) 
Move the pivot entry into the hole in List; 

N «- N + i 

) 
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down into the hole, thus causing the hole to move up. The termination condition con- 
sists of the hole being immediately below a name that is not greater than the pivot or 
of the hole reaching the top of the list. 


L Modify the sequential search procedure in Figure 5.6 to allow for lists that are 
not sorted. 

2. Convert the pseudocode routine 

Z <r- 0; 

X < 1; 

while (X < 6) do 
(Z <- Z + X; 

X <- X+ 1) 

to an equivalent routine using a repeat statement. 

3. Some of the popular programming laftguiages todt&y Wise ithe syntax 

while (. . .) do (. . .) 

to represent a pretest loop and the syntax 
do {. . .) while (. . .) 

to represent a posttest loop. Although elegant in design, what problems could 
result from such similarities? 

4. Suppose the insertion sort as presented in Figure 5.11 was applied to the list 
Gene, Cheryl, Alice, and Brenda. Describe the organization of the list at the 
end of each execution of the body of the outer while structure. 

5. Why would we not want to change the phrase "greater than" in the while state- 
ment in Figure 5.11 to "greater than or equal to"? 

6. A variation of the insertion sort algorithm is the selection sort- It begins by 
selecting the smallest entry in the list and moving it to the front. It then 
selects the smallest entry from the remaining entries in the list and moves it 
to the second position in the list. By repeatedly selecting the smallest entry 
from the remaining portion of the list and moving that entry forward, the 
sorted version of the list grows from the front of the list, while the back por- 
tion of the list consisting of the remaining unsorted entries shrinks. Use our 
pseudocode to express a procedure similar to that in Figure 5.11 for sorting a 
list using the selection sort algorithm. 

7. Another well-known sorting algorithm is the bubble sort. It is based on the 
process of repeatedly comparing two adjacent names and interchanging them 
if they are not in the correct order relative to each other. Let us suppose that 
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the list in question has n entries. The bubble sort would begin by comparing 
(and possibly interchanging) the entries in positions n and n - 1. Then, it 
would consider the entries in positions n -1 and n - 2, and continue moving 
forward in the list until the first and second entries in the list had been com- 
pared (and possibly interchanged). Observe that this pass through the list will 
pull the smallest entry to the front of the list. Likewise, another such pass 
will ensure that the next to the smallest entry will be pulled to the second 
position in the list. Thus, by making a total of n - 1 passes through the list, 
the entire list will be sorted. (If one watches the algorithm at work, one sees 
the small entries bubble to the top of the list-an observation from which the 
algorithm gets its name.) Use our pseudocode to express a procedure similar 
to that in Figure 5.11 for sorting a list using the bubble sort algorithm. 


5.5 Recursive Structures 

Recursive structures provide an alternative to the loop paradigm for implementing the 
repetition of activities. Whereas a loop involves repeating a set of instructions in a man- 
ner in which the set is completed and then repeated, recursion involves repeating 
the set of instructions as a subtask of itself. As an analogy, consider the process of con- 
ducting telephone conversations with the call waiting feature. There, an incomplete 
telephone conversation is set aside while another incoming call is processed. The 
result is that two conversations take place. However, they are not performed one- 
after-the-other as in a loop structure, but instead one is performed within the other. 

The Binary Search Algorithm 

As a way of introducing recursion, let us again tackle the problem of searching to see 
whether a particular entry is in a sorted list, but this time we get our foot in the door 
by considering the procedure we follow when searching a dictionary. In this case we 
do not perform a sequential entry-by-entry or even a page-by-page procedure. Rather, 
we begin by opening the directory to a page in the area where we believe the target 
entry is located. If we are lucky, we will find the target value there; otherwise, we must 
continue searching. But at this point we will have narrowed our search considerably. 

Of course, in the case of searching a dictionary, we have prior knowledge of where 
words are likely to be found. If we are looking for the word somnambulism, we would 
start by opening to the latter portion of the dictionary. In the case of generic lists, 
however, we do not have this advantage, so let us agree to always start our search 
with the "middle" entry in the list. Here we write the word middle in quotation marks 
because the list might have an even number of entries and thus no middle entry in 
the exact sense. In this case, let us agree that the "middle" entry refers to the first 
entry in the second half of the list. 

If the middle entry in the list is the target value, we can declare the search a suc- 
cess. Otherwise, we can at least restrict the search process to the first or last half of 


5.5 Recursive Structures 


241 


Searching and Sorting 


The sequential and binary search algorithms are only two of many algorithms 
for performing the search process. Likewise, the insertion sort is only one of 
many sorting algorithms. Other classic algorithms for sorting include the merge 
sort (discussed in Chapter 11), the selection sort (Question/Exercise 6 in Section 
5.4), the bubble sort (Question/Exercise 7 in Section 5.4), the quick sort (which 
applies a divide-and-conquer approach to the sorting process), and the heap sort 
(which uses a clever technique for finding the entries that should be moved for- 
ward in the list). You will find discussions of these algorithms in the books listed 
under Additional Reading at the end of this chapter. 


the list depending on whether the target value is less than or greater than the entry 
we have considered. (Remember that the list is sorted.) 

To search the remaining portion of the list, we could apply the sequential search, 
but instead let us apply the same approach to this portion of the list that we used for 
the whole list. That is, we select the middle entry in the remaining portion of the list 
as the next entry to consider. As before, if that entry is the target value, we are finished. 
Otherwise we can restrict our search to an even smaller portion of the list. 

This approach to the searching process is summarized in Figure 5.12, where we 
consider the task of searching the list on the left of the Figure for the entry John. We 
first consider the middle entry Harry. Since our target belongs after this entry, the 
search continues by considering the lower half of the original list. The middle of this 
sublist is found to be Larry. Since our target should precede Larry, we turn our atten- 
tion to the first half of the current sublist. When we interrogate the middle of that 

Figure 5.12 Applying our strategy to search a list for the entry John 


Original list First sublist Second sublisit 

Alice 

Bob 

Carol 

David 

Elaine 

Fred 

George 

Harry 


John 

Kelly 

Larry 

Mary 


Irene 



Larry 

Mary 

Nancy 

Oliver 


John 

Kelly 


Irene 


Nancy 

Oliver 
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Recursive Structures in Art 


The following recursive procedure can be applied to a rectangular canvas to pro- 
duce drawings of the style of the Dutch painter Piet Mondrian (1872-1944), who 
produced paintings in which the rectangular canvas was divided into succes- 
sively smaller rectangles. Try following the procedure yourself to produce draw- 
ings similar to the one shown. Begin by applying the procedure to a rectangle 
representing the canvas on which you are working. (If you are wondering 
whether the algorithm represented by this procedure is an algorithm according 
to the definition in Section 5.1, your suspicions are well-founded. It is, in fact, an 
example of a nondeterministic algorithm since there are places at which the per- 
son or machine following the procedure is asked to make "creative" decisions. 
Perhaps this is why Mondrian's results are considered art while ours are not.) 



procedure Mondrian (Rectangle) 

if (the size of Rectangle is too large for your artistic taste) 
then (divide Rectangle into two smaller rectangles; 

apply the procedure Mondrian to one of the smaller rectangles; 
apply the procedure Mondrian to the other smaller rectangle) 


secondary sublist, we find our target John and declare the search a success. In short, 
our strategy is to successively divide the list in question into smaller segments until 
the target is found or the search is narrowed to an empty segment. 

We need to emphasize this last point. If the target value is not in the original list, 
our approach to searching the list will proceed by dividing the list into smaller seg- 
ments until the segment under consideration is empty. At this point our algorithm 
should recognize that the search is a failure. 

Figure 5.13 is a first draft of our thoughts using our pseudocode. It directs us to 
begin a search by testing to see if the list is empty. If so, we are told to report that the 
search is a failure. Otherwise, we are told to consider the middle entry in the list. If 
this entry is not the target value, we are told to search either the front half or the hack 
half of the list. Both of these possibilities require a secondary search. It would be nice 
to perform these searches by calling on the services of an abstract tool. In particular, 
our approach is to apply a procedure named Search to carry out these secondary 
searches. To complete our program, therefore, we must provide such a procedure. 

But this procedure should perform the same task that is expressed by the 
pseudocode we have already written. It should first check to see if the list it is given 
is empty, and if it is not, it should proceed by considering the middle entry of that list. 
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Figure 5.1 3 A first draft of the binary search technique 


if (List empty) 

then 

(Report that the search failed.) 
else 

[Select the "middle" entry in the List to be the TestEntry; 
Execute the block of instructions below that is 
associated with the appropriate case, 
case 1: TargetValue = TestEntry 

(Report that the search succeeded.) 
case 2: TargetValue < TestEntry 

(Search the portion of List preceding TestEntry for 
TargetValue, and report the result of that search.) 
case 3: TargetValue > TestEntry 

(Search the portion of List following TestEntry for 
TargetValue, and report the result of that search.) 

1 end if 


Thus we can supply the procedure we need merely by identifying the current routine 
as being the procedure named Search and inserting references to that procedure where 
the secondary searches are required. The result is shown in Figure 5.14. 

Note that this procedure contains a reference to itself. If we were following this 
procedure and came to the instruction 

Apply the procedure Search . . . 


Figure 5.14 The binary search algorithm in pseudocode 


procedure Search (List, TargetValue) 
if (List empty) 

then 

(Report that the search failed.) 

else 

[Select the "middle" entry in List to be the TestEntry; 

Execute the block of instructions below that is 
associated with the appropriate case, 
case 1: TargetValue = TestEntry 

(Report that the search succeeded.) 
case 2: TargetValue < TestEntry 

(Apply the procedure Search to see if TargetValue 
is in the portion of the List preceding TestEntry, 
and report the result of that search.) 
case 3: TargetValue > TestEntry 

(Apply the procedure Search to see if TargetValue 
is in the portion of List following TestEntry, 
and report the result of that search.) 


] end if 


244 


Algorithms 


we would apply the same procedure to the smaller list that we were applying to the orig- 
inal one. If that search succeeded, we would return to declare our original search suc- 
cessful; if this secondary search failed, we would declare our original search a failure. 

To see how the procedure in Figure 5.14 performs its task, let us follow it as it 
searches the list Alice, Bill, Carol, David, Evelyn, Fred, and George, for the target 
value Bill. Our search begins by selecting David (the middle entry) as the test entry 
under consideration. Since the target value (Bill) is less than this test entry, we are 
instructed to apply the procedure Search to the list of entries preceding David-that 
is, the list Alice, Bill, and Carol. In so doing, we create a second copy of the search pro- 
cedure and assign it to this secondary task. 

We now have two copies of our search procedure being executed, as summarized 
in Figure 5.15. Progress in the original copy is temporarily suspended at the instruction 

Apply the procedure Search to see if TargetValue is 
in the portion of List preceding the TestEntry 

while we apply the second copy to the task of" searching the list Alice, Bill, and Carol. 
When we complete this secondary search, we will discard the second copy of the pro- 
cedure, report its findings to the original copy, and continue progress in the original. 


Figure 5.1 5 


,,We are here. 


procedure Search [List TargelValue) 
if (Ltt empty) 

( failed.) 

) hen I that thr I tilth 
[Select Mm middle entry in IM to be ihe TesiEniry; 
Execute the block ortnslruclions below (h4t 1: 
associated Mich the appropriate case, 
cue I: TaroetValue - TestEntry 

(Report that the search succeeded.} 
use Z: TaigetValue < TestEntry 

(Apply ihe i Search to see il Taigetvalue 

is m the portion of the List preceding TeitEnlry, 
and report the result of that search.) 
case 3; TargetValue > TestEntry 

iApply the procedure iearch to see if TargetValue 
li tn the portion al List tallowing TestEniry, 
and report the resul( of that search,) 

) end if 


procedure Search (List, TargeiViluet 
*• if (.List empty) 

ihcn (Repoti that Hie search failed.) 

•faH 
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Report OM the search succeeded.) 
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(Apply the procedure Search to see if TargetValue 
Is in Ihe portion of the List piectding TestEntry. 
and report the result of that search.) 
case 3; TargelValue > TejtEntry 

(Apply the procedure Search to IM if Tiirgel Vjirur 
Is In the portion of Lrst following TestEntry. 
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I end if 
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In this way, the second copy of the procedure executes as a subordinate to the origi- 
nal, performing the task requested by the original module and then disappearing. 

The secondary search selects Bill as its test entry because that is the middle entry 
in the list Alice, Bill, and Carol. Since this is the same as the target value, it declares 
its search to be a success and terminates. 

At this point, we have completed the secondary search as requested by the orig- 
inal copy of the procedure, so we are able to continue the execution of that original 
copy. Here we are told that the result of the secondary search should be reported as 
the result of the original search. Thus we report that the original search has suc- 
ceeded. Our process has correctly determined that Bill is a member of the list Alice, 
Bill, Carol, David, Evelyn, Fred, and George. 

Let us now consider what happens if we ask the procedure in Figure 5. J 4 to search 
the list Alice, Carol, Evelyn, Fred, and George for the entry David. This time the original 
copy of the procedure selects Evelyn as its test entry and concludes that the target value 
must reside in the preceding portion of the list. It therefore requests another copy of the 
procedure to search the list of entries appearing in front of Evelyn-that is, the two-entry 
list consisting of Alice and Carol. At this stage our situation is as represented in Figure 5.16. 


Figure 5.16 


,W9 are here. 


procedure Search (List, TargetValue) 
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if (List empty) 

then (.Report that the search failed.) 

else 
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and report the result of that search.) 

] end if 


v if (List empty) 

(hen [Report that the search failed.? 

else 

(Select the "middle" entry in List to be the it A t Entry: 
Execute tht? block of instructions below that is 
associated with the appropriate case, 
case h TargetValue = TestEntry 

(Report that the search succeeded.) 
case 2: TargetValLie < TestEntry 

(Apply the procedure Search to see if TargetValue 
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and report the result of that search.) 

] end if 


List 






246 


Algorithms 


The second copy of the procedure selects Carol as its current entry and concludes 
that the target value must lie in the latter portion of its list. It then requests a third 
copy of the procedure to search the list of names following Carol in the list Alice and 
Carol. This sublist is empty, so the third copy of the procedure has the task of searching 
the empty list for the target value David. Our situation at this point is represented by 
Figure 5.17. The original copy of the procedure is charged with the task of searching 
the list Alice, Carol, Evelyn, Fred, and George, with the test entry being Evelyn; the 
second copy is charged with searching the list Alice and Carol, with its test entry 
being Carol; and the third copy is about to begin searching the empty list. 

Of course, the third copy of the procedure quickly declares its search to be a fail- 
ure and terminates. The completion of the third copy's task allows the second copy to 
continue its task. It notes that the search it requested was unsuccessful, declares its own 
task to be a failure, and terminates. This report is what the original copy of the proce- 
dure has been waiting for, so it can now proceed. Since the search it requested failed, 
it declares its own search to have failed and terminates. Our routine has correctly con- 
cluded that David is not contained in the list Alice, Carol, Evelyn, Fred, and George. 

In summary, if we were to lookback at the previous examples, we could see that 
the process employed by the algorithm represented in Figure 5.14 is to repeatedly 
divide the list in question into two smaller pieces in such a way that the remaining 
search can be restricted to only one of these pieces. This divide-by-two approach is 
the reason why the algorithm is known as the binary search. 


Recursive Control 

The binary search algorithm is similar to the sequential search in that each algorithm 
requests the execution of a repetitive process. However, the implementation of this 
repetition is significantly different. Whereas the sequential search involves a circular 
form of repetition, the binary search executes each stage of the repetition as a subtask 
of the previous stage. This technique is known as recursion. 

As we have seen, the illusion created by the execution of a recursive procedure 
is the existence of multiple copies of the procedure, each of which is called an acti- 
vation of the procedure. These activations are created dynamically in a telescoping 
manner and ultimately disappear as the algorithm advances. Of those activations 
existing at any given time, only one is actively progressing. The others are effectively 
in limbo, each waiting for another activation to terminate before it can continue. 

Being a repetitive process, recursive systems are just as dependent on proper con- 
trol as are loop structures. Just as in loop control, recursive systems are dependent on 
testing for a termination condition and on a design that ensures this condition will be 
reached. In fact, proper recursive control involves the same three ingredients-ini- 
tialization, modification, and test for termination-that are required in loop control. 

In general, a recursive procedure is designed to test for the termination condition 
(often called the base case or degenerative case) before requesting further activa- 
tions. If the termination condition is not met, the routine creates another activation 
of the procedure and assigns it the task of solving a revised problem that is closer to 
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the termination condition than that assigned to the current activation. However, if 
the termination condition is met, a path is taken that causes the current activation to 
terminate without creating additional activations. 

Let us sec how the initialization and modification phases of repetitive control are 
implemented in our binary search procedure of Figure 5.14. In this case, the creation 
of additional activations is terminated once the target value is found or the task is 
reduced to that of searching an empty list. The process is initialized implicitly by 
being given an initial list and a target value. From this initial configuration the pro- 
cedure modifies its assigned task to that of searching a smaller list. Since the original 
list is of finite length and each modification step reduces the length of the list in ques- 
tion, we are assured that the target value ultimately is found or the task is reduced to 
that of searching the empty list. We can therefore conclude that the repetitive process 
is guaranteed to cease. 

Finally, since both loop and recursive control structures are ways to cause the 
repetition of a set of instructions, we might ask whether they are equivalent in power. 
That is, if an algorithm were designed using a loop structure, could another algo- 
rithm using only recursive techniques be designed that would solve the same prob- 
lem and vice versa? Such questions are important in computer science because their 
answers ultimately tell us what features should be provided in a programming lan- 
guage in order to obtain the most powerful programming system possible. We will 
return to these ideas in Chapter 1 1 where we consider some of the more theoretical 
aspects of computer science and its mathematical foundations. With this background, 
we will then be able to prove the equivalence of iterative and recursive structures in 
Appendix E. 


Questions 
& Exercises 


1 What names are interrogated by the binaiy search (Figure 5.14) when 
searching for the name Joe in the list Alice, Brenda, Carol, Duane, Evelyn, 
Fred, George, Henry, Irene, Joe, Karl, Larry, Mary, Nancy, and Oliver? 

2 What is the maximum number of entries that must be interrogated when 
applying the binary search to a list of 200 entries? What about a list of 
100,000 entries? 

3 What sequence of numbers would be printed by the following recursive 
procedure if we started it with N assigned the value 1? 

procedure Exercise (N) 
print the value of N; 

if (N < 3) then (apply the procedure Exercise to the value N + 1); 
print the value of N. 


What is the termination condition in the recursive procedure of 
Question/Exercise 3? 
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5.6 Efficiency and Correctness 

In this section we introduce two topics that constitute important research areas within 
computer science. The first of these is algorithm efficiency, and the second is algo- 
rithm correctness. 

Algorithm Efficiency 

Even though today's machines are capable of executing millions of instructions each 
second, efficiency remains a major concern in algorithm design. Often the choice 
between efficient and inefficient algorithms can make the difference between a prac- 
tical solution to a problem and an impractical one. 

Let us consider the problem of a university registrar faced with the task of 
retrieving and updating student records. Although the university has an actual enroll- 
ment of approximately 10,000 students during any one semester, its "current student" 
file contains the records of more than 30,000 students who are considered current in 
the sense that they have registered for at least one course in the past few years but 
have not completed a degree. For now, let us assume that these records are stored in 
the registrar's computer as a list ordered by student identification numbers. To find 
any student record, the registrar would therefore search this list for a particular iden- 
tification number. 

We have presented two algorithms for searching such a list: the sequential search 
and the binary search. Our question now is whether the choice between these two 
algorithms makes any difference in the case of the registrar. We consider the sequen- 
tial search first. 

Given a student identification number, the sequential search algorithm starts at 
the beginning of the list and compares the entries found to the identification number 
desired. Not knowing anything about the source of the target value, we cannot con- 
clude how far into the list this search must go. We can say, though, that after many 
searches we expect the average depth of the searches to be halfway through the list; 
some will be shorter, but others will be longer. Thus, we estimate that over a period 
of time, the sequential search will investigate roughly 15,000 records per search. If 
retrieving and checking each record for its identification number requires 10 mil- 
liseconds (10 one-thousandths of a second), such a search would require an average 
of 150 seconds or 2.5 minutes-an unbearably long time for the registrar to wait for 
a student's record to appear on a computer screen. Even if the time required to retrieve 
and check each record were reduced to only 1 millisecond, the search would still 
require an average of 15 seconds, which is still a long time to wait. 

In contrast, the binary search proceeds by comparing the target value to the mid- 
dle entry in the list. If this is not the desired entry, then at least the remaining search 
is restricted to only half of the original list. Thus, after interrogating the middle entry 
in the list of 30,000 student records, the binary search has at most 15,000 records still 
to consider. After the second inquiry, at most 7,500 remain, and after the third 
retrieval, the list in question has dropped to no more than 3,750 entries. Continuing 
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in this fashion, we see that the target record will be found after retrieving at most 15 
entries from the list of 30,000 records. Thus, if each of these retrievals can be per- 
formed in 10 milliseconds, the process of searching for a particular record requires only 
0.15 of a second-meaning that access to any particular student record will appear to 
be instantaneous from the registrar's point of view. We conclude that the choice 
between the sequential search algorithm and the binary search algorithm would have 
a significant impact in this application. 

This example indicates the importance of the area of computer science known as 
algorithm analysis that encompasses the study of the resources, such as time or stor- 
age space, that algorithms require. A major application of such studies is the evalua- 
tion of the relative merits of alternative algorithms. 

Algorithm analysis often involves best-case, worst-case, and average-case sce- 
narios. In our example, we performed an average-case analysis of the sequential search 
algorithm and a worst-case analysis of the binary search algorithm in order to estimate 
the time required to search through a list of 30,000 entries. In general such analysis 
is performed in a more generic context. That is, when considering algorithms for 
searching lists, we do not focus on a list of a particular length, but instead try to iden- 
tify a formula that would indicate the algorithm's performance for lists of arbitrary 
lengths. It is not difficult to generalize our previous reasoning to lists of arbitrary 
lengths. In particular, when applied to a list with n entries, the sequential search algo- 
rithm will interrogate an average of VJ entries, whereas the binary search algorithm 
will interrogate at most \g n entries in its worst-case scenario, fig n represents the 
base two logarithm of n. ) 

Let us analyze the insertion sort algorithm (summarized in Figure 5.11) in a sim- 
ilar manner. Recall that this algorithm involves selecting a list entry, called the pivot 
entry, comparing this entry to those preceding it until the proper place for the pivot 
is found, and then inserting the pivot entry in this place. Since the activity of com- 
paring two entries dominates the algorithm, our approach will be to count the num- 
ber of such comparisons that are performed when sorting a list whose length is n. 

The algorithm begins by selecting the second list entry to be the pivot. It then pro- 
gresses by picking successive entries as the pivot until it has reached the end of the 
list. In the best possible case, each pivot is already in its proper place, and thus it 
needs to be compared to only a single entry before this is discovered. Thus, in the best 
case, applying the insertion sort to a list with n entries requires n - 1 comparisons. 
(The second entry is compared to one entry, the third entry to one entry, and so on.) 

In contrast, the worst-case scenario is that each pivot must be compared to all the 
preceding entries before its proper location can be found. This occurs if the original 
list is in reverse order. In this case the first pivot (the second list entry) is compared 
to one entry, the second pivot (the third list entry) is compared to two entries, and so 
on (Figure 5.18). Thus the total number of comparisons when sorting a list of n entries 
isl + 2+ 3 + ... + (n- 1), which is equivalent to (Vz)(n 2 - n). In particular, if the 
list contained 10 entries, the worst-case scenario of the insertion sort algorithm would 
require 45 comparisons. 

In the average case of the insertion sort, we would expect each pivot to be com- 
pared to half of the entries preceding it. This results in half as many comparisons as 
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Figure 5.1 8 Applying the insertion sort in a worst-case situation 
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were performed in the worst case, or a total of fVOC* - ri) comparisons to sort a list 
ofn entries. If, for example, we use the insertion sort to sort a variety of lists of length 
10, we expect the average number of comparisons per sort to be 22.5. 

The significance of these results is that the number of comparisons made during 
the execution of the insertion sort algorithm gives an approximation of the amount 
of time required to execute the algorithm. Using this approximation. Figure 5.19 shows 
a graph indicating how the time required to execute the insertion sort algorithm 
increases as the length of the list increases. This graph is based on our worst-case 
analysis of the algorithm, where we concluded that sorting a list of length n would 


Figure 5.1 9 Graph of the worst-case analysis of the insertion sort algorithm 
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require at most (7,}(>i 2 - n) comparisons between list entries. On the graph, we have 
marked several list lengths and indicated the time required in each case. Notice that 
as the list lengths increase by uniform increments, the time required to sort the list 
increases by increasingly greater amounts. Thus the algorithm becomes less efficient 
as the size of the list increases. 

Let us apply a similar analysis to the binary search algorithm. Recall that we con- 
cluded that searching a list with n entries using this algorithm would require interro- 
gating at most Ig ft entries, which again gives an approximation to the amount of time 
required to execute the algorithm for various list sizes. Figure 5.20 shows a graph based 
on this analysis on which we have again marked several list lengths of uniformly 
increasing size and identified the time required by the algorithm in each case. Note that 
the time required by the algorithm increases by decreasing increments. That is, the 
binary search algorithm becomes more efficient as the size of the list increases. 

The distinguishing factor between Figures 5.19 and 5.20 is the general shape of 
the graphs involved. This general shape reveals how well an algorithm should be 
expected to perform for larger and larger inputs. Moreover, the general shape of a 
graph is determined by the type of the expression being represented rather than 
the specifics of the expression-all linear expressions produce a straight line; all 
quadratic expressions produce a parabolic curve; all logarithmic expressions pro- 
duce the logarithmic shape shown in Figure 5.20. It is customary to identify a shape 
with the simplest expression that produces that shape. In particular, we identify the 
parabolic shape with the expression n and the logarithmic shape with the expres- 
sion Ig n. 


Figure 5.20 Graph of the worst-case analysis of the binary search algorithm 
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Since the shape of the graph obtained by comparing the time required for an algo- 
rithm to perform its task to the size of the input data reflects the efficiency charac- 
teristics of the algorithm, it is common to classify algorithms according to the shapes 
of these graphs-normally based on the algorithm's worst-case analysis. The notation 
used to identify these classes is sometimes called big-theta notation. All algorithms 
whose graphs have the shape of a parabola, such as the insertion sort, are put in the 
class represented by G(n 2 ) (read "big theta ofn squared"); all algorithms whose graphs 
have the shape of a logarithmic expression, such as the binary search, fall in the class 
represented by Q(lg n) (read "big theta of log n"). Knowing the class in which a par- 
ticular algorithm falls allows us to predict its performance and to compare it against 
other algorithms that solve the same problem. Two algorithms in 0(n 2 ) will exhibit sim- 
ilar changes in time requirements as the size of the inputs increases. Moreover, the 
time requirements of an algorithm in B{lg n) will not expand as rapidly as that of an 
algorithm in Q(n). 


Software Verification 


Recall that the fourth phase in Polya's analysis of problem solving (Section 5 . 3) is to eval- 
uate the solution for accuracy and for its potential as a tool for solving other problems. 
The significance of the first part of this phase is exemplified by the following example: 


A traveler with a gold chain of seven links must stay in an isolated hotel for seven 
nights. The rent each night consists of one link from the chain. What is the fewest 
number of links that must be cut so that the traveler can pay the hotel one link of the 
chain each morning without paying for lodging in advance? 


To solve this problem we first realize that not every link in the chain must be cut. 
If we cut only the second link, we could free both the first and second links from the 
other five. Following this insight, we are led to the solution of cutting only the second, 
fourth, and sixth links in the chain, a process that releases each link while cutting only 
three (Figure 5.21). Furthermore, any fewer cuts leaves two links connected, so we 
might conclude that the correct answer to our problem is three. 


Figure 5.21 Separating the chain using only three cuts 
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Upon reconsidering the problem, however, we might make the observation that 
when only the third link in the chain is cut, we obtain three pieces of chain of lengths 
one, two, and four [Figure 5.22). With these pieces we can proceed as follows: 

First morning: Give the hotel the single link. 

Second morning: Retrieve the single link and give the hotel the two-link piece. 

Third morning: Give the hotel the single link. 

Fourth morning: Retrieve the three links held by the hotel and give the hotel the four- 

link piece. 

Fifth morning: Give the hotel the single link. 

Sixth morning: Retrieve the single link and give the hotel the double-link piece. 

Seventh morning: Give the hotel the single link. 

Consequently, our first answer, which we thought was correct, is incorrect. How, then, 
can we be sure that our new solution is correct? We might argue as follows: Since a 
single link must be given to the hotel on the first morning, at least one link of the chain 
must be cut, and since our new solution requires only one cut, it must be optimal. 

Translated into the programming environment, this example emphasizes the dis- 
tinction between a program that is believed to be correct and a program that is cor- 
rect. The two are not necessarily the same. The data processing community is rich in 
horror stories involving software that although "known" to be correct still failed at a 
critical moment because of some unforeseen situation. Verification of software is 
therefore an important undertaking, and the search for efficient verification tech- 
niques constitutes an active field of research in computer science. 

A major line of research in this area attempts to apply the techniques of formal 
logic to prove the correctness of a program. That is, the goal is to apply formal logic 
to prove that the algorithm represented by a program does what it is intended to do. 
The underlying thesis is that by reducing the verification process to a formal proce- 
dure, one is protected from the inaccurate conclusions that might be associated with 
intuitive arguments, as was the case in the gold chain problem. Let us consider this 
approach to program verification in more detail. 

Figure 5.22 Solving the problem with only one cut 
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Beyond Verification of Software 

Verification problems, as discussed in the text, are not unique to software. 
Equally important is the problem of confirming that the hardware that executes 
a program is free of flaws. This involves the verification of circuit designs as 
well as machine construction. Again, the state of the art relies heavily on test- 
ing, which, as in the case of software, means that subtle errors can find their 
way into finished products. Records indicate that the Mark I, constructed at 
Harvard University in the 1940s, contained wiring errors that were not detected 
for many years. A more recent example is a flaw in the floating-point portion of 
the early Pentium microprocessors. In both of these cases, the error was 
detected before serious consequences developed. 


Just as a formal mathematical proof is based on axioms (geometric proofs are 
often founded on the axioms of Euclidean geometry, whereas other proofs are based 
on the axioms of set theory), a formal proof of a program's correctness is based on the 
specifications under which the program was designed. To prove that a program cor- 
rectly sorts lists of names, we are allowed to begin with the assumption that the pro- 
gram's input is a list of names, or if the program is designed to compute the average 
of one or more positive numbers, we assume that the input does, in fact, consist of 
one or more positive numbers. In short, a proof of correctness begins with the assump- 
tion that certain conditions, called preconditions, are satisfied at the beginning of the 
program's execution. 

The next step in a proof of correctness is to consider how the consequences of 
these preconditions propagate through the program. For this purpose, researchers 
have analyzed various program structures to determine how a statement, known to 
be true before the structure is executed, is affected by executing the structure. As a 
simple example, if a certain statement about the value ofY is known to hold prior to 
executing the instruction 

X <- Y 

then that same statement can be made about X after the instruction has been 
executed. More precisely, if the value of Y is not 0 before the instruction is 
executed, then we can conclude that the value of X will not be 0 after the 
instruction is executed. 

A slightly more involved example occurs in the case of an if-then-else structure 
such as 

if (condition) then (instruction A) 
else (instruction S) 

Here, if some statement is known to hold before execution of the structure, then 
immediately before executing instruction A, we know that both that statement and 
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the condition tested are true, whereas if instruction B is to be executed, we know 
the statement and the negation of the condition tested must hold. 

Following rules such as these, a proof of correctness proceeds by identifying state- 
ments, called assertions, that can be established at various points in the program. The 
result is a collection of assertions, each being a consequence of the program's precondi- 
tions and the sequence of instructions that lead to the point in the program at which the 
assertion is established. If the assertion so established at the end of the program corre- 
sponds to the desired output specifications, we can conclude that the program is correct. 

As an example, consider the typical while loop structure represented in Figure 
5.23. Suppose, as a consequence of the preconditions given at point A, we can estab- 
lish that a particular assertion is true each time the test for termination is performed 
(point B) during the repetitive process. (An assertion at a point in a loop that is true 
every time that point in the loop is reached is known as a loop invariant.) Then, if 
the repetition ever terminates, execution moves to point C, where we can conclude 
that both the loop invariant and the termination condition hold. (The loop invariant 
still holds because the test for termination does not alter any values in the program, 
and the termination condition holds because otherwise the loop does not terminate.) 
If these combined statements imply the desired output, our proof of correctness can 
be completed merely by showing that the initialization and modification components 
of the loop ultimately lead to the termination condition. 


Figure 5.23 The assertions associated with a typical while structure! 
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You should compare this analysis to our example of the insertion sort shown in 
Figure 5.11. The outer loop in that program is based on the loop invariant 

Each time the test for termination is performed, the entries in the list from 
position 1 through position N - 1 are sorted 

and the termination condition is 

The value of N is greater than the length of the list. 

Thus, if the loop ever terminates, we know that both conditions must be satisfied, 
which implies that the entire list would be sorted. 

Unfortunately, formal program verification techniques have not been refined to 
the point that they can be easily applied in general applications. The result is that in 
most cases today, software is "verified" by testing it under various conditions-a 
process that is shaky at best. After all, verification by testing proves nothing more 
than that the program runs correctly for the cases under which it was tested. Any 
additional conclusions are merely projections. The errors contained in a program are 
often consequences of subtle oversights that are easily overlooked during testing as 
well. Consequently errors in a program, just as our error in the gold chain problem, 
can, and often do, go undetected, even though significant effort has been exerted to 
avoid it. A dramatic example occurred at AT&T: An error in the software controlling 
114 switching stations went undetected from its installation in December 1989 until 
January' 15, 1990, at which time a unique set of circumstances caused approximately 
five million calls to be unnecessarily blocked over a nine-hour period. 


1 . Suppose we find th^t^iiWkacdMiiiiiEe ^ith our insertion sort algo- 

rithm requires an average of one second to sort a list of 100 names. How long & 

do you estimate it takes to sort a list of 1000 names? How about 10,000 

names? 

2 Give an exttfiflijpike rfan algorithm itl eadil tflihT Allowing classes: B(lg n), 0 ( n ) , 
and 0 ( 7 1 1 2 * 4 ) . 

3. List the classes 0(n ), 0{tg n), ©(h), and Q(n) in decreasing order of 
efficiency. 

4 Consider the following problem and a proposed answer. Is the proposed 
answer correct? Why or why not? 

Problem: Suppose a box contains three cards. One of three cards is painted 
black on both sides, one is painted red on both sides, and the third is painted 
red on one side and black on the other. One of the cards is drawn from the 
box, and you are allowed to see one side of it. What is the probability that the 
other side of the card is the same color as the side you see? 


Questions 

Exercises 


Proposed answer: One-half'. Suppose the side of the card you can see is red. 
(The argument would be symmetric with this one if the side were black.) 
Only two cards among the three have a red side. Thus the card you see must 
be one of these two. One of these two cards is red on the other side, while 
the other is black. Thus the card you can see is just as likely to be red on the 
other side as it is to be black. 

5. The following program segment is an attempt to compute the quotient (for- 
getting any remainder) of two positive integers (a dividend and a divisor) by 
counting the number of times the divisor can be subtracted from the divi- 
dend before what is left becomes less than the divisor. For instance, "h 
should produce 2 because 3 can be subtracted from 7 twice. Is the program 
correct? Justify your answer. 

Count <r- 0; 

Remainder <- Dividend; 

repeat {Remainder <~ Remainder - Divisor; 

Count 4- Count + 1 ) 

until (Remainder < Divisor) 

Quotient <- Count. 

6. The following program segment is designed to compute the product of two 
nonnegative integers X and Y by accumulating the sum of X copies of Y- 
that is, 3 times 4 is computed by accumulating the sum of three 4s. Is the 
program correct? Justify your answer. 

Product <- Y; 

Count <r- I; 

while (Count < X) do 
(Product <- Product + Y; 

Count <- Count + 1) 

7. Assuming the precondition that the value associated with jV is a positive 
integer, establish a loop invariant that leads to the conclusion that if the fol- 
lowing routine terminates, then Sum is assigned the value 0 + 1 +'...•+ N. 

S \ m <- 0; 

K <- 0; 

while (K < N) do 

(K «- K + 1 ; 

Sum <- Sum + K) 

Provide an argument to the effect that the routine does in fact terminate. 

8. Suppose that both a program and the hardware that executes it have been 
formally verified to be accurate. Does this ensure ciccuracy? 
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Chapter Review Problems 

(Asterisked problems are associated with optional sections.) 


1 . Give an example of a set of steps that con- 
forms to the informal definition of an algo- 
rithm given in the opening paragraph of 
Section 5.1 but does not conform to the formal 
definition given in Figure 5.1. 

2. Explain the distinction between an ambiguity 
in a proposed algorithm and an ambiguity in 
the representation of an algorithm. 

3 Describe how the use of primitives helps 
remove ambiguities in an algorithm's repre- 
sentation. 

4. Select a subject with which you are familiar 
and design a pseudocode for giving directions 
in that subject. In particular, describe the 
primitives you would use and the syntax you 
would use to represent them. (If you are hav- 
ing trouble thinking of a subject, try sports, 
arts, or crafts.) 

5 Does the following program represent an algo- 
rithm in the strict sense? Why or why not? 

Count <- 0; 
while (Count not 5) do 
(Count <- Count + 2) 

6. In what sense do the following three steps not 
constitute an algorithm? 

Step 1: Draw a straight line segment between 
the points with rectangular coordinates (2,5) 
and (6,11). 

Step 2: Draw a straight line segment between 
the points with rectangular coordinates (1,3) 
and (3,6). 

Step 3; Draw a circle whose center is at the 
intersection of the previous line segments and 
whose radius is two. 

7. Rewrite the following program segment using 

a repeat structure rather than a while structure. 
Be sure the new version prints the same values 
as the original. 


Count <- 2; 
while (Count < 7) do 

(print the value assigned to Count and 
Count « - Count + 1 ) 

6. Rewrite the following program segment using a 
while structure rather than a repeat structure. 
Be sure the new version prints the same values 
as the original. 

Count *- 1; 
repeat 

(print the value assigned to Count and 
Count <- Count +1) 
until (Count = 5) 

9. What must be done to translate a posttest loop 
expressed in the form 

repeat (. . ,) until (, , .) 

into an equivalent posttest loop expressed in 
the form 

do (. . .) while (. . .) 

10. Design an algorithm that, when given an 
arrangement of the digits 0, 1, 2, 3, 4, 5, 6, 7, 

8, 9, rearranges the digits so that the new 
arrangement represents the next larger value 
that can be represented by these digits (or 
reports that no such rearrangement exists if 
no rearrangement produces a larger value). 
Thus 5647382901 would produce 5647382910. 

11. Design an algorithm for finding all the factors 
of a positive integer. For example, in the case 
of the integer 12, your algorithm should report 
the values 1, 2, 3, 4, 6, and 12. 

12. Design an algorithm for determining the day 
of the week of any date since January 1, 1700. 
For example, August 17, 2001 was a Friday. 

13. What is the difference between a formal pro- 
gramming language and a pseudocode? 

14. What is the difference between syntax and 
semantics? 
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15. The following is an addition problem in tradi- 
tional base ten notation. Each letter represents 
a different digit. What digit does each letter 
represent? How did you get your foot in the 
door? 

XYZ 
+ YWY 

ZYZW 

16. The following is a multiplication problem in 
traditional base ten notation. Each letter repre- 
sents a different digit. What digit does each let- 
ter represent? How did you get your foot in 
the door? 

XY 
x YX 

XY 

YZ_ 

WVY 

1 7. The following is an addition problem in binary 
notation. Each letter represents a unique 
binary digit. Which letter represents 1 and 
which represents 0? Design an algorithm for 
solving problems like this. 

YXX 
+ XYX 

XYYY 

18. Four prospectors with only one lantern must 
walk through a mine shaft. At most, two 
prospectors can travel together and any 
prospector in the shaft must be with the 
lantern. The prospectors, named Andrews, 
Blake, Johnson, and Kelly, can walk through 
the shaft in one minute, two minutes, four min- 
utes, and eight minutes, respectively. When 
two walk together they travel at the speed of 
the slower prospector. How can all four 
prospectors get through the mine shaft in only 

1 5 minutes? After you have solved this prob- 
lem, explain how you got your foot in the door. 

19. Starting with a large wine glass and a small 
wine glass, fill the small glass with wine and 
then pour that wine into the large glass. Next, 
fill the small glass with water and pour some' 


of that water into the large glass. Mix the con- 
tents of the large glass, and then pour the mix- 
ture back into the small glass until the small 
glass is full. Will there be more water in the 
large glass than there is wine in the small 
glass? After you have solved this problem, 
explain how you got your foot in the door. 

2 0 . Two bees, named Romeo and Juliet, live in dif- 
ferent hives but have met and fallen in love. 
On a windless spring morning, they simulta- 
neously leave their respective hives to visit 
each other. Their routes meet at a point 50 
meters from the closest hive, but they fail to 
see each other and continue on to their desti- 
nations. At their destinations, they spend the 
same amount of time to discover that the 
other is not home and begin their return trips. 
On their return trips, they meet at a point that 
is 20 meters from the closest hive. This time 
they see each other and have a picnic lunch 
before returning home. How far apart arc the 
two hives? After you have solved this problem, 
explain how you got your foot in the door. 

2 1 Design an algorithm that, given two strings 
of characters, tests whether the first string 
appears as a substring somewhere in the 
second. 

22 The following algorithm is designed to print 
the beginning of what is known as the 
Fibonacci sequence. Identify the body of the 
loop. Where is the initialization step for the 
loop control? The modification step? The test 
step? What list of numbers is produced? 

Last <r- 0; 

Current «- 1; 
while (Current < 100) do 
(print the value assigned to Current; 

Temp i- Last; 

Last <- Current; and 
Current <- Last + Temp) 

23. What sequence of numbers is printed by the 
following algorithm if it is started with input 
values 0 and 1 ? 
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procedure MysteryWrite (Last, Current) 
if (Current < 1 00} then 
(print the value assigned to Current; 

Temp <- Current + Last; 

apply MysteryWrite to the values Current and 
Temp) 

24. Modify the procedure MysteryWrite in the pre- 
ceding problem so that the values are printed 
in reverse order. 

25. What letters are interrogated by the binary 
search (Figure 5.14) if it is applied to the list 
A, B, C, D, E, F, G, H, I, J, K, L, M, N, O when 
searching for the value J? What about search- 
ing for the value Z? 

26 . After performing many sequential searches on 
a list of 6,000 entries, what would you expect 
to be the average number of times that the tar- 
get value would have been compared to a list 
entry? What if the search algorithm was the 
binary search? 

27. Identify the termination condition in each of 
the following iterative statements. 

a. while (Count < 5) do 

( ) 

b. repeat 

( ) 

until (Count = 1) 

c. while ((Count < 5) and (Total < 56)} do 

( ) 

28 . Identify the body of the following loop struc- 
ture and count the number of times It will be 
executed. What happens if the test is changed 
to read while (Count not 6)? 

Count A 1; 

while (Count not 7) do 

(print the value assigned to Count and 
Count «- Count+ 3) 

29 . What problems do you expect to arise if the 
following program is implemented on a com- 
puter? {Hint: Remember the problem of 
round-off errors associated with floating-point 
arithmetic.) 


Count <r- one- tenth; 

repeat 

(print the value assigned to Count and 
Count Count + one-tenth) 
until (Count equals 1) 

30 . Design a recursive version of the Euclidean 
algorithm (Question 3 of Section 5.2). 

3 1 . Suppose we apply both Testl and Test2 

(defined below) to the input value 1 . what is 
the difference in the printed output of the two 
routines? 

procedure Testl (Count) 
if (Count not 5) 

then (print the value assigned to Count 

and apply Testl to the value Count + 1 ) 
procedure Test2 (Count) 
if (Count not 5) 

then (apply Test2 to the value Count + 1 

and print the value assigned to Count) 

32 . Identify the important constituents of the con- 
trol mechanism in the routines of the previous 
problem. In particular, what condition causes 
the process to terminate? Where is the state of 
the process modified toward this termination 
condition? Where is the state of the control 
process initialized? 

33 . Identify the termination condition m the 
following recursive procedure, 

procedure XXX (N) 

if (N = 5) then (apply the procedure XXX to the 
value N + 1 ) 

34. Apply the procedure MysteryPrint (defined 
below) to the value 3 and record the values 
that are printed. 

procedure MysteryPrint (N) 

if (N > 0) then (print the value of N and 

apply the procedure MysteryPrint 
to the value N - 2) 

Print the value of N + 1. 

35 . Apply the procedure MysteryPrint (defined 
below) to the value 2 and record the values 
that are printed. 
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procedure MysteryPrint (N) 
if (N > 0) then (print the value of N and 
apply the procedure 
MysteryPrint to the value N - 2} 
else (print the value of N and 
if ( N >- 1 ) t h e t i (apply the 

procedure MysteryPrint to 
the value N + 1)) 

36 . Design an algorithm to generate the sequence 
of positive integers (in increasing order) 
whose only prime divisors are 2 and 3; that is, 
your program should produce the sequence 2, 

3, 4, 6, 8, 9, 12, 16, 18, 24, 27, Does your 

program represent an algorithm in the strict 
sense? 

37 . Answer the following questions in terms of 
the list: Alice, Byron, Carol, Duane, Elaine, 
Floyd, Gene, Henry, Iris. 

a. Which search algorithm (sequential or 
binary) will find the name Gene more 
quickly? 

b. Which search algorithm (sequential or 
binary) will find the name Alice more 
quickly? 

c. Which search algorithm (sequential or 
binary) will detect the absence of the name 
Bruce more quickly? 

& Which search algorithm (sequential or 

binary) will detect the absence of the name 
Sue more quickly? 

e. How many entries will be interrogated 
when searching for the name Elaine when 
using the sequential search? How many 
will be interrogated when using the binary 
search? 

38. The factorial ofO is defined to be 1. The facto- 
rial of a positive integer is defined to be the 
product of that integer times the factorial of 
the next smaller nonnegative integer. We use 
the notation n! to express the factorial of the 
integer n. Thus the factorial of 3 (written 3!) is 
3 x (2!) = 3 x (2 x (1!)) = 3 x (2 x (1 x (0!))) 
= 3 x (2 x (1 x (1))) = 6. Design a recursive 


algorithm that computes the factorial of a 
given value. 

39 . a. Suppose you must sort a list of five names, 

and you have already designed an algo- 
rithm that sorts a list of four names. Design 
an algorithm to sort the list of five names 
by taking advantage of the previously 
designed algorithm, 

b. Design a recursive algorithm to sort arbi- 
trary lists of names based on the technique 
used in (a) . 

40. The puzzle called the Towers of Hanoi consists 
of three pegs, one of which contains several 
rings stacked in order of descending diameter 
from bottom to top. The problem Is to move 
the stack of rings to another peg. You are 
allowed to move only one ring at a time, and 
at no time is a ring to be placed on top of a 
smaller one. Observe that if the puzzle 
involved only one ring, it would be extremely 
easy. Moreover, when faced with the problem 
of moving several rings, if you could move all 
but the largest ring to another peg, the largest 
ring could then be placed on the third peg, 
and then the problem would be to move the 
remaining rings on top of it. Using this obser- 
vation, develop a recursive algorithm for solv- 
ing the Towers of Hanoi puzzle for an 
arbitrary number of rings. 



41. Another approach to solving the Towers of 
Hanoi puzzle (Problem 40) is to imagine the 
pegs arranged on a circular stand with a peg 
mounted at each of the positions of 4, 8, and 
12 o’clock. The rings, which begin on one of 
the pegs, are numbered 1,2,3, and so on, 
starting with the smallest ring being 1. Odd- 
numbered rings, when on top of a stack, are 
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allowed to move clockwise to the next peg; 
likewise, even-numbered rings are allowed to 
move counterclockwise (as long as that move 
does not place a ring on a smaller one). 
Under this restriction, always move the 
largest-numbered ring that can be moved. 
Based on this observation, develop a nonre- 
cursive algorithm for solving the Towers of 
Hanoi puzzle. 



42. Develop two algorithms, one based on a loop 
structure and the other on a recursive struc- 
ture, to print the daily salary of a worker who 
each day is paid twice the previous day's 
salary (starting with one penny for the first 
day's work) for a 30-day period. What prob- 
lems relating to number storage are you likely 
to encounter if you implement your solutions 
on an actual machine? 

43. Design an algorithm to find the square root of 
a positive number by starting with the number 
itself as the first guess and repeatedly producing 
a new guess from the previous one by averag- 
ing the previous guess with the result of divid- 
ing the original number by the previous guess. 
Analyze the control of this repetitive process. 
In particular, what condition should terminate 
the repetition? 

44. Design an algorithm that lists all possible 
rearrangements of the symbols in a string of 
five distinct characters. 

45 . Design an algorithm that, given a list of 
names, finds the longest name in the list. 
Determine what your solution does if there 
are several "longest" names in the list. In par- 


ticular, what would your algorithm do if all the 
names had the same length? 

46. Design an algorithm that, given a list of five or 
more numbers, finds the five smallest and five 
largest numbers in the list without sorting the 
entire list. 

47. Arrange the names Brenda, Doris, Raymond, 
Steve, Timothy, and William in an order that 
requires the least number of comparisons 
when sorted by the insertion sort algorithm 
(Figure 5.11). 

48 What is the largest number of entries that are 
interrogated if the binary search algorithm 
(Figure 5.14) is applied to a list of 4000 
names? How does this compare to the sequen- 
tial search (Figure 5.6)? 

49. Use big-theta notation to classify the traditional 
grade school algorithms for addition and multi- 
plication. That is, if asked to add two numbers 
each having n digits, how many individual 
additions must be performed. If requested to 
multiply two n-digit numbers, how many indi- 
vidual multiplications are required? 

50, Sometimes a slight change in a problem can 
significantly alter the form of its solution. For 
example, find a simple algorithm for solving 
the following problem and classify it using big- 
theta notation: 

Divide a group of people into two disjoint sub- 
groups (of arbitrary size) such that the differ- 
ence in the total ages of the members of the 
two subgroups is as large as possible. 

Now change the problem so that the desired 
difference is as small as possible and classify 
your approach to the problem. 

5 1 . From the following list, extract a collection of 
numbers whose sum is 3165. How efficient is 
your approach to the problem? 

26, 39, 104, 195, 403, 504, 793, 995, 1156, 1677 

52. Does the loop in the following routine termi- 
nate? Explain your answer. Explain what 


264 Algorithms 


might happen if this routine is actually exe- 
cuted by a computer (refer to Section 1.7). 

X «- 1 ; 

y <- 

while (X not equal 0) do 
(X <_ X - Y; 

Y i- Y •¥ 2) 

53. The following program segment is designed to 
compute the product of two nonnegative inte- 
gers X and Y by accumulating the sum of X 
copies of Y; that is, 3 times 4 is computed by 
accumulating the sum of three 4s. Is the pro- 
gram segment correct? Explain your answer. 

Product <- 0; 

Count 4- 0; 

repeat (Product <- Product + Y, 

Count <- Count + 1 ) 
until (Count = X) 

54. The following program segment is designed to 
report which of the positive integers X and Y is 
larger. Is the program segment correct? 
Explain your answer. 

Difference <- X - Y; 
if (Difference is positive) 

then (print "X is bigger than Y") 
else (print "Y is bigger than X") 

55. The following program segment is designed to 
find the largest entry in a nonempty list of 
integers. Is it correct? Explain your answer. 


TestValue <- first list entry; 

CurrentEntry <- first list entry; 
while (CurrentEntry is not the last entry) do 
(if (CurrentEntry > TestValue) 

then (TestValue <- CurrentEntry) 
CurrentEntry «- the next list entry) 

56. a. Identify the preconditions for the sequen- 

tial search as represented in Figure 5.6. 
Establish a loop invariant for the while 
Structure in that program that, when com- 
bined with the termination condition, 
implies that upon termination of the loop, 
the algorithm will report success or failure 
correctly. 

b. Give an argument showing that the while 
loop in Figure 5 . 6 does in fact terminate. 

57. Based on the preconditions that X and Y are 
assigned nonnegative integers, identify a loop 
invariant for the following while structure that, 
when combined with the termination condi- 
tion, implies that the value associated with Z 
upon loop termination must be X - Y. 

2 4 — X; 

J <r- 0; 

while (J < Y) do 
(Z < - Z - 1; 

J <- J + 1) 


Social Issues 


The following questions are Intended as a guide to the ethical/social/legal issues asso- 
ciated with the field of computing. The goal is not merely to answer these questions. 
You should also consider why you answered as you did and whether your justifications 
are consistent from one question to the next. 

I. As it is currently impossible to verify completely the accuracy of complex 
programs, under what circumstances, if any, should the creator of a program 
be liable for errors? 
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2 Suppose you have an idea and develop it into a product that many people can 
use. Moreover, it has required a year of work and an investment of $50,000 to 
develop your idea into a form that is useful to the general public. In its final 
form, however, the product can be used by most people without buying any- 
thing from you. What right do you have for compensation? Is it ethical to 
pirate computer software? What about music and motion pictures? 

3, Suppose a software package is so expensive that it is totally out of your price 
range. Is it ethical to copy it for your own use? (After all, you are not cheating 
the supplier out of a sale because you would not have bought the package 
anyway.) 

4 Ownership of rivers, forests, oceans, etc. has long been an issue of debate. In 
what sense should someone or some institution be given ownership of an 
algorithm'.' 

5. Some people feel that new algorithms are discovered, whereas others feel that 
new algorithms are created. To which philosophy do you subscribe? Would 
the different points of view lead to different conclusions regarding ownership 
of algorithms and ownership rights? 

6 Is it ethical to design an algorithm for performing an illegal act? Does it mat- 
ter whether the algorithm is ever executed? Should the person who creates 
such an algorithm have ownership rights to that algorithm? If so, what should 
those rights be? Should algorithm ownership rights be dependent on the pur- 
pose of the algorithm? Is it ethical to advertise and circulate techniques for 
breaking security? Does it matter what is being broken into? 

7 An author is paid for the motion picture rights to a novel even though the 
story is often altered in the film version. How much of a story has to change 
before it becomes a different story? What alterations must be made to an algo- 
rithm for it to become a different algorithm? 

8. Educational software is now being marketed for children in the 18 months or 
younger age group. Proponents argue that such software provides sights and 
sounds that would otherwise not be available to many children. Opponents 
argue that it is a poor substitute for personal parent/child interaction. What is 
your opinion? Should you take any action based on your opinion without 
knowing more about the software? If so, what action? 
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In this chapter we study programming 
languages. Our purpose is not to learn a 
particular language. Rather it is to learn 
about programming languages. We want to 
appreciate the commonality as well as the 
diversity among programming languages 
and their associated methodologies. 
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Machine Independence and Beyond 
Programming Paradigms 


6.2 Traditiona I Ifrac# ommirng 
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Variables and Data Types 
Data Structure 
Constants and Literals 
Assignment Statements 
Control Statements 
Comments 
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Parameters 

Functions 
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Software Development Packages 
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*6.6 Programming Concurrent 
Activities 


*6.7 Declarative Programming 

Logical Deduction 
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The development of complex software systems such as operating systems, network 
software, and the vast array of application software available today would likely be 
impossible if humans were forced to write programs in machine language. Dealing 
with the intricate detail associated with such languages while trying to organize com- 
plex systems would be a taxing experience, to say the least. Consequently, program- 
ming languages similar to our pseudocode have been developed that allow algorithms 
to be expressed in a form that is both palatable to humans and easily convertible into 
machine language instructions. Our goal in this chapter is to explore the sphere of 
computer science that deals with the design and implementation of these languages. 


6.1 Historical Perspective 

We begin our study by tracing the historical development of programming languages. 

Early Generations 

As we learned in Chapter 2, programs for modern computers consist of sequences of 
instructions that are encoded as numeric digits. Such an encoding system is known 
as a machine language. Unfortunately, writing programs in a machine language is a 
tedious task that often leads to errors that must be located and corrected (a process 
known as debugging) before the job is finished. 

In the 1940s, researchers simplified the programming process by developing nota- 
tional systems by which instructions could be represented in mnemonic rather than 
numeric form. For example, the instruction 

Move the contents of register 5 to register 6 
would be expressed as 
4056 

using the machine language introduced in Chapter 2, whereas in a mnemonic system 
it might appear as 

MOV R 5 , R6 

As a more extensive example, the machine language routine 

156C 

166D 

5056 

306E 

COOO 

which adds the contents of memory cells 6C and 6D and stores the result at 
location 6E (Figure 2.7 of Section 2.2) might be expressed as 

LD R5 f Price 

LD R6, ShippingCharqe 

ADDI R0.R5 R6 

ST RO, TotalCost 

HLT 
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using mnemonics. (Here we have used LD, ADDI, ST, and HLT to represent load, add, 
store, and halt. Moreover, we have used the descriptive names Price, Ship- 
pingCharge, and TotalCost to refer to the memory cells at locations 6C, 6D, and 
6E, respectively. Such descriptive names are often called identifiers.) Note that the 
mnemonic form, although still lacking, does abetterjob of representing the meaning 
of the routine than does the numeric form. 

Once such a mnemonic system was established, programs called assemblers 
were developed to convert mnemonic expressions into machine language instruc- 
tions. Thus, rather than being forced to develop a program directly in machine lan- 
guage, a human could develop a program in mnemonic form and then have it 
converted into machine language by means of an assembler. 

A mnemonic system for representing programs is collectively called an assem- 
bly language. At the time assembly languages were first developed, they represented 
a giant step forward in the search for better programming techniques. In fact, assem- 
bly languages were so revolutionary that they became known as second-generation 
languages, the first generation being the machine languages themselves. 

Although assembly languages have many advantages over their machine-language 
counterparts, they still fall short of providing the ultimate programming environ- 
ment. After all, the primitives used in an assembly language are essentially the same 
as those found in the corresponding machine language. The difference is simply in 
the syntax used to represent them. Thus a program written in an assembly language 
is inherently machine dependent-that is, the instructions within the program are 
expressed in terms of a particular machine's attributes. In turn, a program written in 
assembly language cannot be easily transported to another computer design because 
it must be rewritten to conform to the new computer's register configuration and 
instruction set. 

Another disadvantage of an assembly language is that a programmer, although not 
required to code instructions in numeric form, is still forced to think in terms of the 
small, incremental steps of the machine's language. The situation is analogous to 
designing a house in terms of boards, nails, bricks, and so on. It is true that the actual 
construction of the house ultimately requires a description based on these elemen- 
tary pieces, but the design process is easier if we think in terms of larger units such 
as rooms, windows, doors, and so on. 

In short, the elementary primitives in which a product must ultimately be con- 
structed are not necessarily the primitives that should be used during the product's 
design. The design process is better suited to the use of high-level primitives, each rep- 
resenting a concept associated with a major feature of the product. Once the design 
is complete, these primitives can be translated to lower-level concepts relating to the 
details of implementation. 

Following this philosophy, computer scientists began developing programming lan- 
guages that were more conducive to software development than were the low-level 
assembly languages. The result was the emergence of a third generation of programming 
languages that differed from previous generations in that their primitives were both 
higher level (in that they expressed instructions in larger increments) and machine 
independent (in that they did not rely on the characteristics of a particular machine). 
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The best-known early examples are FORTRAN (FORmula TRANslator), which was 
developed for scientific and engineering applications, and COBOL (COmmon Business- 
Oriented Language), which was developed by the U.S. Navy for business applications. 

In general, the approach to third-generation programming languages was to iden- 
tify a collection of high-level primitives (in essentially the same spirit with which we 
developed our pseudocode in Chapter 5) in which software could be developed. Each 
of these primitives was designed so that it could be implemented as a sequence of the 
low-level primitives available in machine languages. For example, the statement 

assign TotalCost the value Price + ShippingChar ge 

expresses a high-level activity without reference to how a particular machine should 
perform the task, yet it can be implemented by the sequence of machine instructions 
discussed earlier. Thus, our pseudocode structure 

identifier <- expression 
is a potential high-level primitive. 

Once this collection of high-level primitives had been identified, a program, called 
a translator, was written that translated programs expressed in these high-level prim- 
itives into machine-language programs. Such a translator was similar to the second- 
generation assemblers, except that it often had to compile several machine instructions 
into short sequences to simulate the activity requested by a single high-level primi- 
tive. Thus, these translation programs were often called compilers. 

An alternative to translators, called interpreters, emerged as another means of 
implementing third-generation languages. These programs were similar to transla- 
tors except that they executed the instructions as they were translated instead of 
recording the translated version for future use. That is, rather than producing a 
machine-language copy of a program that would be executed later, an interpreter actu- 
ally executed a program from its high-level form. 

As a side issue we should note that the task of promoting third-generation pro- 
gramming languages was not as easy as might be imagined. The thought of writing 
programs in a form similar to a natural language was so revolutionary that many in 
managerial positions fought the notion at first. Grace Hopper, who is recognized as the 
developer of the first compiler, often told the story of demonstrating a translator for 
a third-generation language in which German terms, rather than English, were used. 
The point was that the programming language was constructed around a small set of 
primitives that could be expressed in a variety of natural languages with only simple 
modifications to the translator. But she was surprised to find that many in the audi- 
ence were shocked that, in the years surrounding World War II, she would be teach- 
ing a computer to "understand" German. Today we know that understanding a natural 
language involves much, much more than responding to a few rigorously defined 
primitives. Indeed, natural languages (such as English, German, and Latin) are dis- 
tinguished from formal languages (such as programming languages) in that the lat- 
ter are precisely defined by grammars (Section 6.4) whereas the former evolved over 
time without formal grammatical analysis (Section 10.2). 
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Cross-Platform Software 

A typical application program must rely on the operating system to perform many 
of its tasks. It may require the services of the window manager to communicate 
with the computer user, or it may use the file manager to retrieve data from mass 
storage. Unfortunately, different operating systems dictate that requests for these 
services be made in different ways. Thus for programs to be transferred and exe- 
cuted across networks and internets involving different machine designs and dif- 
ferent operating systems, the programs must be operating-system independent as 
well as machine independent. The term cross -platform is used to reflect this addi- 
tional level of independence. That is, cross-platform software is software that is 
independent of an operating system's design as well as the machine's hardware 
design and is therefore executable throughout a network. 


Machine Independence and Beyond 

With the development of third-generation languages, the goal of machine independ- 
ence was largely achieved. Since the statements in a third-generation language did not 
refer to the attributes of any particular machine, they could be compiled as easily for 
one machine as for another. A program written in a third-generation language could 
theoretically be used on any machine simply by applying the appropriate compiler. 

Reality, however, has not proven to be this simple. When a compiler is designed, 
particular characteristics of the underlying machine are sometimes reflected as con- 
ditions on the language being translated. For example, the different ways in which 
machines handle I/O operations have historically caused the "same" language to have 
different characteristics, or dialects, on different machines. Consequently, it is often 
necessary to make at least minor modifications to a program to move it from one 
machine to another. 

Compounding this problem of portability is the lack of agreement in some cases 
as to what constitutes the correct definition of a particular language. To aid in this 
regard, the American National Standards Institute and the International Organization 
for Standardization have adopted and published standards for many of the popular lan- 
guages. In other cases, informal standards have evolved because of the popularity of 
a certain dialect of a language and the desire of other compiler writers to produce 
compatible products. However, even in the case of highly standardized languages, 
compiler designers often provide features, sometimes called language extensions, that 
are not part of the standard version of the language. If a programmer takes advantage 
of these features, the program produced will not be compatible with environments 
using a compiler from a different vendor. 

In the overall history of programming languages, the fact that third-generation lan- 
guages fell short of true machine independence is actually of little significance for two 
reasons. First, they were close enough to being machine independent that software 
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could be transported from one machine to another with relative ease. Second, the goal 
of machine independence turned out to be only a seed for more demanding goals. 
Indeed, the realization that machines could respond to such high-level statements as 


assign TotalCost the value Price + ShippingCharge 


led computer scientists to dream of programming environments that would allow 
humans to communicate with machines in terms of abstract concepts rather than forc- 
ing them to translate these concepts into machine-compatible form. Moreover, com- 
puter scientists wanted machines that could perform much of the algorithm discovery 
process rather than just algorithm execution. The result has been an ever-expanding 
spectrum of programming languages that challenges a clear-cut classification in terms 
of generations. 


Programming Paradigms 


The generation approach to classifying programming languages is based on a linear 
scale (Figure 6.1) on which a language's position is determined by the degree to which 
the user of the language is freed from the world of computer gibberish and allowed 
to think in terms associated with the problem. In reality, the development of pro- 
gramming languages has not progressed in this manner but has developed along dif- 
ferent paths as alternative approaches to the programming process (called 
programming paradigms) have surfaced and been pursued. Consequently, the his- 
torical development of programming languages is better represented by a multiple- 
track diagram as shown in Figure 6.2, in which different paths resulting from different 
paradigms are shown to emerge and progress independently. In particular, the figure 
presents four paths representing the functional, object-oriented, imperative, and 
declarative paradigms, with various languages associated with each paradigm posi- 
tioned in a manner that indicates their births relative to other languages. (It does not 
imply that one language necessarily evolved from a previous one.) 


Figure 6.1 Generations of programming languages 
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Figure 6.2 The evolution of programming paradigms 


Ll^l 


1 1 

j ML 

Scheme] 

| 

i 

1 1 

1 1 

1 

1 

1 

1 

1 

» 

i 

Visual Basic 

1 1 

1 

Smalltalk! 

C++ 1 

Java 1 

1 1 

1 

I 

1 

1 

Machine 1 FORTRAN 1 BASIC 

r 1 

I Ada 

1 

1 

Languages 1 COBOL ALC^jOL APL 

i 

i 

Pascal ' 

1 

"T 

i 

i 

1 

1 GPSS 

i 

Prolog 1 

i 

1 


1950 


1960 


1SB0 


Functional 


Object-oriented 


Imperative 


Declarative 


2000 


We should note that although the paradigms identified in Figure 6.2 are called 
programming paradigms, these alternatives have ramifications beyond the program- 
ming process. They represent fundamentally different approaches to building solu- 
tions to problems and therefore affect the entire software development process. In this 
sense, the term programming paradigm is a misnomer. A more realistic term would be 
software development paradigm. 

The imperative paradigm, also known as the procedural paradigm, repre- 
sents the traditional approach to the programming process. It is the paradigm on 
which our pseudocode of Chapter 5 is based as well as the machine language dis- 
cussed in Chapter 2. As the name suggests, the imperative paradigm defines the pro- 
gramming process to be the development of a sequence of commands that, when 
followed, manipulate data to produce the desired result. Thus the imperative paradigm 
tells us to approach the programming process by finding an algorithm to solve the 
problem at hand and then expressing that algorithm as a sequence of commands. 

In contrast to the imperative paradigm is the declarative paradigm, which asks 
a programmer to describe the problem to be solved rather than an algorithm to be fol- 
lowed. More precisely, a declarative programming system applies a pre established 
general-purpose problem-solving algorithm to solve problems presented to it. In such 
an environment the task of a programmer becomes that of developing a precise state- 
ment of the problem rather than of describing an algorithm for solving the problem. 

A major obstacle in developing programming systems based on the declarative par- 
adigm is the need for an underlying problem-solving algorithm. For this reason early 
declarative programming languages tended to be special-purpose in nature, designed for 
use in particular applications. For example, the declarative approach has been used for 
many years to simulate a system (political, economic, environmental, etc.) in order to 
test hypotheses or to obtain predictions. In these settings, the underlying algorithm is 
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essentially the process of simulating the passage of time by repeatedly recomputing 
values of parameters (gross domestic product, trade deficit, and so on) based on the 
previously computed values. Thus, implementing a declarative language for such sim- 
ulations requires that one first implement an algorithm that performs this repetitive pro- 
cedure. Then the only task required of a programmer using the system is to describe 
the situation to be simulated. In this manner, a weather forecaster does not need to 
develop an algorithm for forecasting the weather but merely describes the current 
weather status, allowing the underlying simulation algorithm to produce weather pre- 
dictions for the near future. 

A tremendous boost was given to the declarative paradigm with the discovery 
that the subject of formal logic within mathematics provides a simple problem-solv- 
ing algorithm suitable for use in a general-purpose declarative programming system. 
The result has been increased attention to the declarative paradigm and the emergence 
of logic programming, a subject discussed in Section 6.7. 

Another programming paradigm is the functional paradigm. Under this para- 
digm a program is viewed as an entity that accepts inputs and produces outputs. Math- 
ematicians refer to such entities as functions, which is the reason this approach is 
called the functional paradigm. Under this paradigm a program is constructed by con- 
necting smaller predefined program units (predefined functions) so that each unit's 
outputs are used as another unit's inputs in such a way that the desired overall input- 
to-output relationship is obtained. In short, the programming process under the func- 
tional paradigm is that of building functions as nested complexes of simpler functions. 

As an example, Figure 6.3 shows how a function for balancing your checkbook can 
be constructed from two simpler functions. One of these, called Find_sum, accepts 
values as its input and produces the sum of those values as its output. The other, 
called Find_diff, accepts two input values and computes their difference. The struc- 
ture displayed in Figure 6.3 can be represented in the LISP programming language (a 
prominent functional programming language) by the expression 

(Find_diff (Find_sum 01d_balance Credits) (Find_sum Debits)) 

The nested structure of this expression reflects the fact that the inputs to the function 
Find_diff are produced by two applications of Find_sum. The first application of 
Find A sum produces the result of adding all the Credits to the 01d_balance. The 
second application ofFind_sum computes the total of all Debits. Then, the function 
Find_diff uses these results to obtain the new checkbook balance. 

To more fully understand the distinction between the functional and imperative 
paradigms, let us compare the functional program for balancing a checkbook to the 
following pseudocode program obtained by following the imperative paradigm: 

Total_credits <- sum of all Credits 
Temp_balance <- 01d_balance + T o t a 1 _ c r e d i t s 
Total_debits <- sum of all Debits 
Balance <- Temp_balance - Total_debits 

Note that this imperative program consists of multiple statements, each of which 
requests that a computation be performed and that the result be stored for later use. 
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Figure 6.3 A function for checkbook balancing constructed from simpler functions 
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In contrast, the functional program consists of a single statement in which the result 
of each computation is immediately channeled into the next. In a sense, the impera- 
tive program is analogous to a collection of factories, each converting its raw materi- 
als into products that are stored in warehouses. From these warehouses, the products 
are later shipped to other factories as they are needed. But the functional program is 
analogous to a collection of factories that are coordinated so that each produces only 
those products that are ordered by other factories and then immediately ships those 
products to their destinations without intermediate storage. This efficiency is one of 
the benefits proclaimed by proponents of the functional paradigm. 

Still another programming paradigm (and the most prominent one in today's soft- 
ware development) is the object-oriented paradigm, which is associated with the 
programming process called object-oriented programming (OOP). Following this 
paradigm, a software system is viewed as a collection of units, called objects, each 
of which is capable of performing the actions that are immediately related to itself as 
well as requesting actions of other objects. Together, these objects interact to solve the 
problem at hand. 

As an example of the object-oriented approach at work, consider the task of devel- 
oping a graphical user interface. In an object-oriented environment, the icons that appear 
on the screen would be implemented as objects. Each of these objects would encom- 
pass a collection of procedures (called methods in the object-oriented vernacular) 
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describing how that object is to respond to the occurrence of various events, such as 
being selected by a click of the mouse button or being dragged across the screen by the 
mouse. Thus the entire system would be constructed as a collection of objects, each of 
which knows how to respond to the events related to it. 

To contrast the object-oriented paradigm with the imperative paradigm, consider 
a program involving a list of names. In the traditional imperative paradigm, this list 
would be merely a collection of data. Any program unit accessing the list would have 
to contain the algorithms for performing the required manipulations. In the object- 
oriented approach, however, the list would be constructed as an object that consisted 
of the list together with a collection of methods for manipulating the list. (This might 
include procedures for inserting a new entry in the list, deleting an entry from the 
list, detecting if the list is empty, and sorting the list.) In turn, another program unit 
that needed to manipulate the list would not contain algorithms for performing the per- 
tinent tasks. Instead, it would make use of the procedures provided in the object. In a 
sense, rather than sorting the list as in the imperative paradigm, the program unit 
would ask the list to sort itself. 

Although we will discuss the object-oriented paradigm in more detail in the 
optional Section 6.5, its significance in today's software development arena dictates 
that we include the concept of a class in this introduction. Our examples have demon- 
strated that an object can consist of data (such as a list of names) together with a col- 
lection of methods for performing activities (such as inserting new names in the list). 
The descriptions of the data and methods within an object are collected in a program 
unit called a class. Several objects can be based on the same class. Like identical twins, 
these objects would be distinct entities but would have the same characteristics since 
they are built from the same template (the same class). Thus, once a class has been 
constructed, it can be reused anytime an object with those characteristics is needed. 
(An object that is built using a particular class is said to be an instance of that class.) 

It is because objects are well-defined units whose descriptions are isolated in 
reusable classes that the object-oriented paradigm has gained popularity. Indeed, pro- 
ponents of object-oriented programming argue that the object-oriented paradigm pro- 
vides a natural environment for the "building block" approach to software 
development. They envision software libraries of predefined classes from which new 
software systems can be constructed in the same way that many traditional products 
are constructed from off-the-shelf components. Such libraries have already been con- 
structed, as we will learn in Chapter 7. 

In closing, we should note that the methods within an object are essentially small 
imperative program units. This means that most programming languages based on the 
object-oriented paradigm contain many of the features found in imperative languages. 
For instance, the popular object-oriented language C + + was developed by adding 
object-oriented features to the imperative language known as C. Moreover, since Java 
and C# are derivatives ofC + + , they too have inherited this imperative core. In Sec- 
tions 6.2 and 6.3 we will explore many of these imperative features, and in so doing, 
we will be discussing concepts that permeate a vast majority of today’s object-ori- 
ented software. Then, in Section 6.5, we will consider features that are unique to the 
object-oriented paradigm. 
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1 . In what sense is a program in a third-generation language machine independent? 
In what sense is it still machine dependent? 

2. what is the difference between an assembler and a compiler? 

3 We can summarize the iimutperatiwe fOffiadigm by is&ymg ttbat it 

places emphasis on describing a process that leads to the solution of the prob- 
lem at hand. Give a similar summary of the declarative, functional, and 
object-oriented paradigms. 

4. In what sense are the third-generaticwffl pfogramiMiififlg languages at a higher 
level than the earlier generations? 


6.2 Traditional Programming Concepts 

In this section we consider some of the concepts found in imperative as well as object- 
oriented programming languages. For this purpose we will draw examples from the lan- 
guages Ada, C, C + +, C#, FORTRAN, and Java. C is a third-generation imperative 
language. C ++ is an object-oriented language that was developed as an extension of the 
language C. Java and C# are object-oriented languages derived from C + +. (Java is a 
product of Sun Microsystems, whereas C# is was developed by Microsoft.) FORTRAN and 
Ada were originally designed as third-generation imperative languages although their 
newer versions have expanded to encompass most of the object-oriented paradigm. 

Appendix D contains abrief background of each of these languages as well as an 
example of how the insertion sort algorithm could be implemented in each. You might 
wish to refer to this appendix as you read this section. Keep in mind, however, that 
our purpose is to develop an understanding of the basic features found in program- 
ming languages. Our use of specific languages is merely to show how the features 
discussed might actually be implemented. Thus you should not allow yourself to 
become entangled in the details of any single language. 

Even though we are including object-oriented languages such as C+ + , Java, and 
C# among our example languages, we will approach this section as though we were 
writing a program in the imperative paradigm, because many units within an object- 
oriented program (such as the procedures describing how an object should react to an 
outside stimulus) are essentially short imperative programs. Later, in Section 6.5, we 
will focus on features unique to the object-oriented paradigm. 

Statements in our example programming languages tend to fall into three categories: 
declarative statements, imperative statements, and comments. Declarative statements 
define customized terminology that is used later in the program, such as the names 
used to reference data items; imperative statements describe steps in the underlying 
algorithms; and comments enhance the readability of a program by explaining its eso- 
teric features in a more human-compatible form. Normally, an imperative program (or 
an imperative program unit such as a procedure) begins with a collection of declarative 
statements describing the data to be manipulated by the program. This preliminary 
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material is followed by imperative statements tbat describe the algorithm to be executed 
(Figure 6.4). Comment statements are dispersed as needed to clarify the program. Let 
us, then, begin our presentation with concepts associated with declaration statements. 


Variables and Data Types 

As suggested in Section 6.1, high-level programming languages allow locations in main 
memory to be referenced by descriptive names rather than by numeric addresses. 
Such a name is known as a variable, in recognition of the fact that by changing the 
value stored at the location, the value associated with the name changes as the program 
executes. Our example languages require that variables be identified via a declarative 
statement prior to being used elsewhere in the program. These declarative statements 
also require that the programmer describe the type of data that will be stored at the 
memory location associated with the variable. 

Such a type is known as a data type and encompasses both the manner in which 
the data item is encoded and the operations that can be performed on that data. For 
example, the type integer refers to numeric data consisting of whole numbers, probably 
stored using two's complement notation. Operations that can be performed on integer data 
include the traditional arithmetic operations and comparisons of relative size, such as 
determining whether one value is greater than another. The type real (sometimes called 
float) refers to numeric data that might contain values other than whole numbers, prob- 
ably stored in floating-point notation. Operations performed on data of type real are sim- 
ilar to those performed on data of type integer. Recall, however, that the activity required 
for adding two items of type real differs from that for adding two items of type integer. 

Suppose, then, that we wanted to use the variable WeightLimit in a program to 
refer to an area of main memory containing a numeric value encoded in two's com- 
plement notation. In the languages C, C+ + , Java, and C# we would declare our inten- 
tion by inserting the statement 

int WeightLimit; 

toward the beginning of the program. This statement means "The name WeightLimit 
will be used later in the program to refer to a memory area containing a value stored 


Figure 6.4 The composition of a typical imperative program or program unit 
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in two's complement notation." Multiple variables of the same type can normally be 
declared in the same declaration statement. For example, the statement 

int Height, Width; 

would declare both Height and Width to be variables of type integer. Moreover, 
most languages allow a variable to be assigned an initial value when it is declared. 
Thus, 


int WeightLimit = 100; 

would not only declare WeightLimit to be a variable of type integer but also assign 
it the starting value 100. 

Other common data types include character and Boolean. The type character 
refers to data consisting of symbols, probably stored using ASCII or Unicode. Opera- 
tions performed on such data include comparisons such as determining whether one 
symbol occurs before another in alphabetical order, testing to see whether one string 
of symbols appears inside another, and concatenating one string of symbols at the 
end of another to form one long string. The statement 

char Letter, Digit; 

could be used in the languages C, C+ + , C#, and Java to declare the variables Letter 
and D i g i t to be of type character. 

The type Boolean refers to data items that can take on only the values true or 
false. Operations on data of type Boolean include inquiries as to whether the current 
value is true or false. For example, if the variable LimitExceeded was declared to be 
of type Boolean, then a statement of the form 

if (LimitExceeded) then (...) else (...) 

would be reasonable. 

The data types that are included as primitives in a programming language, such 
as int for integer and char for character, are called primitive data types. As we have 
learned, the types integer, real/float, character, and Boolean are common primitives. 
Other data types that have not yet become widespread primitives include images, 
audio, video, and hypertext. However, types such as GIF, JPEG, and HTML might 
soon become as common as integer and real. Later (Sections 6.5 and 8.4) we will learn 
how the object-oriented paradigm enables a programmer to extend the repertoire of 
available data types beyond the primitive types provided in a language. Indeed, this 
ability is a celebrated trait of the object-oriented paradigm. 

In summary, the following program segment, expressed in the language C and its 
derivatives C + + , C* and Java, declares the variables Length and width to be of 
type float/real, the variables Price, Tax, and Total to be of type integer, and the 
variable Symbol to be of type character. 

float Length, Width; 
int Price, Tax, Total; 
char Symbol; 
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In Section 6.4 we will see how a translator uses the knowledge that it gathers from such 
declaration statements to help it translate a program from a high-level language into 
machine language. For now, we note that such information can be used to identify 
errors. For example, a statement requesting the addition of two variables that were 
declared to be of type Boolean would probably represent an error. 

Data Structure 

In addition to data type, variables in a program are often associated with data struc- 
ture, which is the conceptual shape or arrangement of data. For example, text is 
normally viewed as a long string of characters whereas sales records might be 
viewed as a rectangular table of numeric values, where each row represents the 
sales made by a particular employee and each column represents the sales made 
on a particular day. 

One common data structure is the homogeneous array, which is a block of val- 
ues of the same type such as a one-dimensional list, a two-dimensional table with 
rows and columns, or tables with higher dimensions. To establish such an array in a 
program, most programming languages require that the declaration statement declar- 
ing the name of the array also specify the length of each dimension of the array. For 
example. Figure 6.5 displays the conceptual structure declared by the statement 

int Scores [2] [9] ; 

in the language C, which means "The variable Scores will be used in the following 
program unit to refer to a two-dimensional array of integers having two rows and nine 
columns." The same statement in FORTRAN would be written as 

THTEGER Scores (2,9) 

Once a homogeneous array has been declared, it can be referenced elsewhere in 
the program by its name, or an individual component can be identified by means of 
integer values called indices that specify the row, column, and so on, desired. How- 
ever, the range of these indices varies from language to language. For example, in C 


Figure 6.5 A two-dimensional array with two rows and nine columns 
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(and its derivatives C ++ , Java, and C#) indices start at 0, meaning that the entry in 
the second row and fourth column of the array called Scores (as declared above) 
would be referenced by Scores [ 1 ] [ 3 ], and the entry in the first row and first col- 
umn would be Scores[0] [ 0 ] . In contrast, indices start at 1 in a FORTRAN program 
so the entry in the second row and fourth column would be referenced by 
Scores (2,4) (see again Figure 6.5). 

In contrast to a homogeneous array in which all data items are the same type, a 
heterogeneous array is a block of data in which different elements can have dif- 
ferent types. For instance, a block of data referring to an employee might consist of 
an entry called Name of type character, an entry called Age of type integer, and an 
entry called SkillRating of type real. Such an array would be declared in C by 
the statement 

struct {char Name [25] ; 

int Age ; 

float SkillRating; 

} Employee; 

which says that the variable Employee is to refer to a structure (abbreviated struct) 
consisting of three components called Name (a string of 25 characters). Age, and 
SkillRating (Figure 6.6). Once such an array has been declared, a programmer 
can use the array name (Employee) to refer to the entire array or can reference indi- 
vidual components within the array by means of the array name followed by a period 
and the component name (such as Employee. Age) . 

In Chapter 8 we will see how conceptual structures such as arrays are actually 
implemented inside a computer. In particular, we will learn that the data contained 
in an array might be scattered over a wide area of main memory or mass storage. 
This is why we refer to data structure as being the conceptual shape or arrangement 
of data. Indeed, the actual arrangement within the computer's storage system might 
be quite different from its conceptual arrangement. 


Figure 6.6 The conceptual structure of the heterogeneous array Employee 
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Constants and Literals 

Sometimes a fixed, predetermined value is used in a program. For example, a pro- 
gram for controlling air traffic in the vicinity of a particular airport might contain 
numerous references to that airport's altitude above sea level. When writing such a 
program, one can include this value, say 645 feet, literally each time it is required. Such 
an explicit appearance of a value is called a literal. The use of literals leads to pro- 
gram statements such as 

EffectiveAlt «- Altimeter + 645 

where EffectiveAlt and Altimeter are assumed to be variables and 645 is a lit- 
eral. Thus, this statement asks that the variable Ef feet ive Alt be assigned the result 
of adding 645 to the value assigned to the variable Altimeter. 

In most programming languages, literals consisting of text are delineated with 
quotation marks to distinguish them from other program components. For instance, 
the statement 

LastWame <- "Smith" 

might be used to assign the text "Smith" to the variable LastName, whereas the statement 

LastWame e- Smith 

would be used to assign the value of the variable Smith to the variable LastName. 

Often, the use of literals is not good programming practice because literals can 
mask the meaning of the statements in which they appear. How, for instance, can a 
reader of the statement 

EffectiveAlt «- Altimeter + 645 

know what the value 645 represents? Moreover, literals can complicate the task of 
modifying the program should it become necessary. If our air traffic program is moved 
to another airport, all references to the airport's altitude must be changed. If the lit- 
eral 645 is used in each reference to that altitude, each such reference throughout 
the program must be located and changed. The problem is compounded if the literal 
645 also occurs in reference to a quantity other than the airport's altitude. How do we 
know which occurrences of 645 to change and which to leave alone? 

To solve these problems, programming languages allow descriptive names to be 
assigned to specific, nonchangeable values. Such a name is called a constant. As an 
example, in C + + and C#, the declarative statement 

const int AirportAlt = 645; 

associates the identifier Airport Alt with the fixed value 645 (which is considered 
to be of type integer). The similar concept in Java is expressed by 

final int AirportAlt = 645; 

Following such declarations, the descriptive name AirportAlt can be used in 
lieu of the literal 645. Using such a constant in our pseudocode, the statement 
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EffectiveAlt +- Altimeter + 645 
could be rewritten as 

EffectiveAlt « - Altimeter + AirportAlt 

which better represents the meaning of the statement. Moreover, if such constants are 
used in place of literals and the program is moved to another airport whose altitude is 
267 feet, then changing the single declarative statement in which the constant is defined 
is all that is needed to convert all references to the airport's altitude to the new value. 

Assignment Statements 

Once the special terminology to be used in a program (such as the variables and con- 
stants) has been declared, a programmer can begin to describe the algorithms involved. 
This is done by means of imperative statements. The most basic imperative state- 
ment is the assignment statement, which requests that a value be assigned to a vari- 
able (or more precisely, stored in the memory area identified by the variable). Such 
a statement normally takes the syntactic form of a variable, followed by a symbol rep- 
resenting the assignment operation, and then by an expression indicating the value 
to be assigned. The semantics of such a statement is that the expression is to be eval- 
uated and the result stored as the value of the variable. For example, the statement 

Z = X + Y; 

in C, C + + , C# and Java requests that the sum ofX and Y be assigned to the variable 
Z. In some other languages (such as Ada) the equivalent statement would appear as 

Z : = X + Y ; 

Note that these statements differ only in the syntax of the assignment operator, which 
in C, C+ + , C* and Java is merely an equal sign but in Ada is a colon followed by an 
equal sign. Perhaps abetter notation for the assignment operator is found in APL, a 
language that was designed by Kenneth E. Iverson in 1962, (APL stands for A Pro- 
gramming Language.) It uses an arrow to represent assignment. Thus, the preceding 
assignment would be expressed as 

Z 4 - X + Y 

in APL (as well as in our pseudocode of Chapter 5). 

Much of the power of assignment statements comes from the scope of expressions 
that can appear on the right side of the statement. In general, any algebraic expres- 
sion can be used, with the arithmetic operations of addition, subtraction, multiplica- 
tion, and division typically represented by the symbols +,-,*, and /, respectively. 
Languages differ, however, in the manner in which these expressions are interpreted. 
For example, the expression 2*4 + 6/2 could produce the value 14 if it is evaluated 
from right to left, or 7 if evaluated from left to right. These ambiguities are normally 
resolved by rules of operator precedence, meaning that certain operations are given 
precedence over others. The traditional rules of algebra dictate that multiplication 
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and division have precedence over addition and subtraction. That is, multiplications 
and divisions are performed before additions and subtractions. Following this con- 
vention, the preceding expression would produce the value 11. In most languages, 
parentheses can be used to override the language's operator precedence. Thus 2 * 
(4 + 6) / 2 would produce the value 10. 

Many programming languages allow the use of one symbol to represent more 
than one operation. In these cases the meaning of the symbol is determined by the 
data type of the operands. For example, the symbol + traditionally indicates addition 
when its operands are numeric, but in some languages, such as Java, the symbol indi- 
cates concatenation when its operands are character strings. That is, the result of the 
expression 

"abra" + "cadabra" 

is abracadabra. Such multiple use of an operation symbol is called overloading. 


Control Statements 

A control statement is an imperative statement that alters the execution sequence 
of the program. Of all the programming statements, those from this group have prob- 
ably received the most attention and generated the most controversy. The major vil- 
lain is the simplest control statement of all, the goto statement. It provides a means 
of directing the execution sequence to another location that has been labeled for this 
purpose by a name or number. It is therefore nothing more than a direct application 
of the machine-level JUMP instruction. The problem with such a feature in a high-level 
programming language is that it allows programmers to write rat's nests like 

goto 4 0 

20 Apply procedure Evade 

goto 70 

40 if (Kry ptoniteLe vel < LethalDose) then goto 60 
goto 20 

60 Apply procedure RescueDamsel 

70 

when a single statement such as 

if (KryptoniteLevel < LethalDose) 

then (apply procedure RescueDamsel) 
else (apply procedure Evade) 

does thejob. 

To avoid such complexities, modern languages are designed with control state- 
ments that allow an entire branching structure to be expressed within a single state- 
ment. The choice of which control statements to incorporate into a language is a 
design decision. The goal is to provide a language that not only allows algorithms to 
be expressed in a readable form but also assists the programmer in obtaining such read- 
ability. This is done by restricting the use of those features that have historically led 
to sloppy programming while encouraging the use of better-designed features. The 
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result is the practice known as structured programming, which encompasses an 
organized design methodology combined with the appropriate use of the language's 
control statements. The idea is to produce a program that can be readily compre- 
hended and shown to meet its specifications. 

Figure 6.7 presents some common branching structures and the control state- 
ments provided in various programming languages for representing those structures. 
Note that the first two structures are those that we have already encountered in Chap- 
ter 5. They are represented by the if-then-else and while statements in our 
pseudocode. The third structure, known as the case structure, can be viewed as an 


Figure 6.7 Control structures and their representations in C, C + + , C#, and Java 
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Programming Language Cultures 

As with natural languages, users of different programming languages tend to 
develop cultural differences and often debate the merits of their perspectives. 
Sometimes these differences are significant as, for instance, when different pro- 
gramming paradigms are involved. In other cases, the distinctions are subtle. 
For example, whereas the text distinguishes between procedures and functions 
(Section 6.3), C programmers refer to both as functions. This is because a proce- 
dure in a C program is thought of as a function that does not return a value. A 
similar example is that C + + programmers refer to a procedure within an object 
as a member function, whereas the generic term for this is method. This dis- 
crepancy can be traced to the fact that C + + was developed as an extension of 
C. Another cultural difference is that programs in Ada are normally typeset 
with reserved words in bold-a tradition that is not widely practiced by users of 
C, C + + , C#, FORTRAN, or Java. 

Although this book is language neutral and uses generic terminology, each 
specific example is presented in a form that is compatible with the style of the 
language involved. As you encounter these examples, you should keep in mind 
that they are presented as examples of how generic ideas appear in actual lan- 
guages-not as a means of teaching the details of a particular language. Try to 
look at the forest rather than the trees. 


extension of the if-then-else structure. Whereas the if-then-else allows a 
choice between two options, the case allows a selection between many options. 

Another common structure, often represented by a for statement, is shown in 
Figure 6.8. This is a loop structure similar to that represented by the while state- 
ment in our pseudocode. The difference is that all the initialization, modification, and 
termination of the loop is incorporated into a parenthetical structure within a sin- 
gle statement. Such a statement is convenient when the body of the loop is to be 
performed once for each value within a specific range. In particular, the statement 
in Figure 6.8 directs that the loop body be performed repeatedly-first with the value 
of Count being 1, then with the value of Count being 2 , and again with the value of 
Count being 3. 

The point to be made from the examples we have cited is that common branch- 
ing structures appear, with slight variations, throughout the gamut of imperative 
and object-oriented programming languages. A somewhat surprising result from 
theoretical computer science is that only a few of these structures are needed to 
ensure that a programming language provides a means of expressing a solution to 
any problem that has an algorithmic solution. We will investigate this claim in Chap- 
ter 11. For now, we merely point out that learning a programming language is not 
an endless task of learning different control statements. Most of the control struc- 
tures found in today's programming languages are essentially variations of those 
we have identified here. 
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Figure 6.8 The for loop structure and its representation in C++, C#, and Java 
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Comments 

No matter how well a programming language is designed and how well the language's 
features are applied in a program, additional information is usually helpful or manda- 
tory when a human tries to read and understand the program. For this reason, pro- 
gramming languages provide ways of inserting explanatory statements, called 
comments, within a program. These statements are ignored by a translator, and there- 
fore their presence or absence does not affect the program from a machine's point of 
view. The machine-language version of the program produced by a translator will be 
the same with or without comments, but the information provided by these statements 
constitutes an important part of the program from a human's perspective. Without 
such documentation, large, complex programs can easily thwart the comprehension of 
a human programmer. 

There are two common ways of inserting comments within a program. One is to 
surround the entire comment by special markers, one at the beginning of the com- 
ment and one at the end. The other is to mark only the beginning of the comment 
and allow the comment to occupy the remainder of the line to the right of the marker. 
We find examples of both these techniques in C + + , C#, and Java. They allow com- 
ments to be bracketed by /• and V, but they also allow a comment to begin with // 
and extend through the remainder of the line. Thus both 

/* This is a comment. */ 


and 
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// This is a comment. 

are valid comment statements. 

A few words are in order about what constitutes a meaningful comment. Begin- 
ning programmers, when told to use comments for internal documentation, tend to 
follow a program statement such as 

Approach Angle = SlipAngle + H y p er S p ac e 1 n c 1 i n e ; 

with a comment such as "Calculate ApproachAngle by adding HyperSpacelncline and 
SlipAngle." Such redundancy adds length rather than clarity to a program. The purpose 
of a comment is to explain the program, not to repeat it. A more appropriate comment 
in this case might be to explain why ApproachAngle is being calculated (if that is not 
obvious). For example, the comment, "ApproachAngle is used later to compute Force- 
FieldJettisonVelocity and is not needed after that," is more helpful than the previous one. 

Additionally, comments that are scattered among a program's statements can some- 
times hamper a human's ability to follow the program's flow and thus make it harder 
to comprehend the program than if no comments had been included. A good approach 
is to collect comments that relate to a single program unit into one place, perhaps at the 
beginning of the unit. This provides a central place where the reader of the program unit 
can look for explanations. It also provides a location in which the purpose and general 
characteristics of the program unit can be described. If this format is adopted for all 
program units, the entire program is given a degree of uniformity in which each unit 
consists of ablock of explanatory statements followed by the formal presentation of the 
program unit. Such uniformity in a program enhances its readability. 


& Exercises 


6.3 Procedural Units 

In previous chapters we have seen advantages to dividing large programs into man- 
ageable units. In this section we focus on the concept of a procedure, which is the 
major technique for obtaining a modular representation of a program in an impera- 
tive language. Moreover, in object-oriented languages, it is by means of procedures that 
programmers specify how objects should respond to various stimuli. 


1 Why is the use of a constant considered better programming style than the 
use of a literal? 

2 What is the difference between a declarative statement and an imperative 
statement? 

3 List some common data types. 

4 . Identify some common control structures found in imperative and object- 
oriented programming languages. 

5 What is the difference between a homogeneous array and a heterogeneous 
array? 
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Procedures 


A procedure, in its generic sense, is a set of instructions for performing a task that 
can be used as an abstract tool by other program units. Control is transferred to the 
procedure at the time its services are required and then returned to the original pro- 
gram unit after the procedure has finished (Figure 6.9). The process of transferring 
control to a procedure is often referred to as calling or invoking the procedure. We will 
refer to a program unit that requests the execution of a procedure as the calling unit. 

In many respects a procedure is a miniature program, consisting of declaration 
statements that describe variables used in the procedure followed by imperative state- 
ments that describe the steps to be performed when the procedure is executed. As a 
general rule, a variable declared within a procedure is a local variable, meaning that 
it can be referenced only within that procedure. This eliminates any confusion that 
might occur if two procedures, written independently, happen to use variables of the 
same name. (The portion of a program in which a variable can be referenced is called 
the scope of the variable. Thus, the scope of a local variable is the procedure in which 
it is declared. Variables whose scopes are not restricted to a particular part of a program 
are called global variables. Most programming languages provide a means of declar- 
ing both local and global variables.) 

In our example programming languages, procedures are defined in much the same 
way as in our pseudocode of Chapter 5. The definition begins with a statement, known 
as the procedure's header, that identifies, among other things, the name of the pro- 
cedure. Following this header are the statements that define the procedure's details. 

In contrast to our informal pseudocode of Chapter 5 in which we requested the 
execution of a procedure by a statement such as "Apply the procedure Deacti- 
vate Krypton," most modern programming languages allow procedures to be called by 

Figure 6.9 The flow of control involving o procedure 
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merely stating the procedure's name. For example, if GetNames, SortNames, and 
WriteNames were the names of procedures for acquiring, sorting, and printing a list 
of names, then a program to get, sort, and print the list could be written as 

GetNames 
SortName s ; 

WriteNames; 

rather than 

Apply the procedure GetNames. 

Apply the procedure SortNames . 

Apply the procedure WriteNames. 

Note that by assigning each procedure a name that indicates the action performed by 
the procedure, this condensed form appears as a sequence of commands that reflect 
the meaning of the program. 

Parameters 

Procedures are often written using generic terms that are made specific when the pro- 
cedure is applied. For example. Figure 5.11 of the preceding chapter presents a pseudocode 
version of a procedure that is expressed in terms of a generic list rather than a specific 
list. In our pseudocode, we agreed to identify such generic terms within parentheses in 
the procedure's header. Thus the procedure in Figure 5.11 begins with the header 

procedure sort (List) 

and then proceeds to describe the sorting process using the term List to refer to the 
list being sorted. If we want to apply the procedure to sort a wedding guest list, we need 

Visual Basic 


Visual Basic is an object-oriented programming language that was developed by 
Microsoft as a tool by which users of Microsoft's Windows operating system 
could develop their own GUI applications. Actually, Visual Basic is more than a 
language-it is an entire software development package that allows a program- 
mer to construct applications from predefined components (such as buttons, 
checkboxes, textboxes, scrollbars, etc.) and to customize these components by 
describing how they should react to various events. In the case of a button, for 
example, the programmer would describe what should happen when that but- 
ton is clicked. In Chapter 7 we will learn that this strategy of constructing soft- 
ware from predefined components represents the current trend in software 
development techniques. 

The popularity of the Windows operating system combined with the con- 
venience of the Visual Basic development package has promoted Visual Basic to 
a widely used programming language. Whether this prominence will continue 
now that Microsoft has introduced CA remains to be seen. 
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merely follow the directions in the procedure, assuming that the generic term List 
refers to the wedding guest list. If, however, we want to sort a membership list, we need 
merely interpret the generic term List as referring to the membership list. 

Such generic terms within procedures are called parameters. More precisely, 
the terms used within the procedure are called formal parameters and the precise 
meanings assigned to these formal parameters when the procedure is applied are 
called actual parameters. In a sense, the formal parameters represent slots in the pro- 
cedure into which actual parameters are plugged when the procedure is requested. 

In general, programming languages follow the format of our pseudocode for iden- 
tifying the formal parameters in a procedure. That is, most programming languages 
require that, when defining a procedure, the formal parameters be listed in paren- 
theses in the procedure's header. As an example, Figure 6.10 presents the definition 
of a procedure named Proj ect Population as it might be written in the program- 
ming language C. The procedure expects to be given a specific yearly growth rate 
when it is called. Based on this rate, the procedure computes the projected population 
of a species, assuming an initial population of 100, for the next 10 years, and stores 
these values in a global array called Population. 

Most programming languages also use parenthetical notation to identify the actual 
parameters when a procedure is called. That is, the statement requesting the execu- 
tion of a procedure consists of the procedure name followed by a list of the actual 
parameters enclosed in parentheses. Thus, rather than a statement such as 

Figure 6.10 The procedure Project Population written in the programming language C 


Starting the head with the term 
"void" is the way that a C 

programmer specifies that the 
program unit is a procedure 
rather than a function. We will 
learn about functions shortly. 


The formal parameter list. Note 
that C, as with many programming 
languages, requires that the data 
type of each parameter be specified. 


void ProjectPopulation (float GrowthRate) 


{ int Year; 


This declares 
named Year. 


a local variable 


Population [ o ] = ioo . 0; 

for (Year = 0 ; Year =< 10 ; Year++) 

Population[Year + i] = Population[Year] + (Population [Year] * GrowthRate); 


These statements describe how the 

populations are to be computed and 
stored in the global array named 

Population. 
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Apply Proj ectPopulation using a growth rate of 0.03 
that we used in our pseudocode, the statement 

ProjectPopulation(0.03); 

would be used in a C program to call the procedure ProjectPopulation of Figure 
6.10 using a growth rate of 0.03. 

When more than one parameter is involved, the actual parameters are associ- 
ated, entry by entry, with the formal parameters listed in the procedure's header-the 
first actual parameter is associated with the first formal parameter, etc. Then, the val- 
ues of the actual parameters are effectively transferred to their corresponding formal 
parameters, and the procedure is executed. 

To emphasize this point, suppose the procedure PrintCheck was defined with 
a header such as 

procedure P r i n t C h e c k { P ay e e , Amount) 

where Payee and Amount are formal parameters used within the procedure to refer 
to the person to whom the check is to be payable and the amount of the check, respec- 
tively. Then, calling the procedure with the statement 

PrintCheck(" John Doe", 150) 

would cause the procedure to be executed with the formal parameter Payee being 
associated with the actual parameter John Doe and the formal parameter Amount 
being associated with the value 150. However, calling the procedure with the statement 

PrintCheck( 1 5 0 , "John Doe") 

would cause the value 150 to be assigned to the formal parameter Payee and the 
name John Doe to be assigned to the formal parameter Amount, which would lead to 
erroneous results. 

The task of transferring data between actual and formal parameters is handled in 
a variety of ways by different programming languages. In some languages a dupli- 
cate of the data represented by the actual parameters is produced and gi ven to the pro- 
cedure. Using this approach, any alterations to the data made by the procedure are 
reflected only in the duplicate-the data in the calling program unit are never changed. 
We often say that such parameters are passed by value. Note that passing parame- 
ters by value protects the data in the calling unit from being mistakenly altered by a 
poorly designed procedure. For example, if the calling unit passed an employee's 
name to a procedure, it might not want the procedure to change that name. 

Unfortunately, passing parameters by value is inefficient when the parameters 
represent large blocks of data. A more efficient technique is to give the procedure 
direct access to the actual parameters by telling it the addresses of the actual parame- 
ters in the calling program unit. In this case we say that the parameters are passed by 
reference. Note that passing parameters by reference allows the procedure to modify 
the data residing in the calling environment. Such an approach would be desirable in 
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the case of a procedure for sorting a list since the point of calling such a procedure 
would be to cause changes in the list. 

As an example, Jet us suppose that the procedure Demo was defined as 

procedure Demo (Formal) 

Formal <- Formal + 1 ; 

Moreover, suppose that the variable Actual was assigned the value 5 and we called 
Demo with the statement 

Demo (Actual ) 

Then, if parameters were passed by value, the change to Formal in the procedure 
would not be reflected in the variable Actual (Figure 6.11). But, if parameters were 
passed by reference, the value of Actual would be incremented by one (Figure 6.12). 

Figure 6.1 1 Executing the procedure Demo and passing parameters by value 
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Figure 6.12 Executing the procedure Demo and passing parameters by reference 
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Different programming languages provide different parameter-passing techniques, 
but in all cases the use of parameters allows a procedure to be written in a generic 
sense and applied to specific data at the appropriate time. 

Functions 

Let use pause to consider a slight variation of the procedure concept that is found in 
many programming languages. At times the purpose of a procedure is to produce a 
value rather than perform an action. (Consider the subtle distinction between a pro- 
cedure whose purpose is to estimate the number of widgets that will be sold as opposed 
to a procedure for playing a simple game-the emphasis in the former is to produce 
a value, the emphasis in the latter is to perform an action.) If the purpose is to pro- 
duce a value, the "procedure" might be implemented as a function. Here the term 
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function refers to a program unit similar to a procedure except that a value is trans- 
ferred back to the calling program unit as "the value of the function." That is, as a 
consequence of executing the function, a value will be computed and sent back to 
the calling program unit. This value can then be stored in a variable for later refer- 
ence or used immediately in a computation. For example, a C, C + + , Java, or C# pro- 
grammer might write 


Proj ected JanS ale s = E stimatedS ale s (January ) ,- 


to request that the variable Proj ected JanS ale s be assigned the result of applying 
the function EstimatedS ales to determine how many widgets are expected to be 
sold in January. Or, the programmer might write 


if (Last JanS ales < EstimatedS ales (January } ) 

else . . . 


to cause different actions to be performed depending on whether this January's sales 
are expected to be better than those of last January. Note that in the second case, the 
value computed by the function is used to determine which branch should be taken, 
but it is never stored. 

Functions are defined within a program in much the same way as procedures. The 
difference is that a function header usually begins by specifying the data type of the 
value that is to be returned, and the function definition usually ends with a return 
statement in which the value to be returned is specified. Figure 6.13 presents a defi- 
nition of a function named Cy 1 inderVolume as it might be written in the language 
C. (Actually, a C programmer would use a more succinct form, but we will use this 

Figure 6. 1 3 The function CylinderVolume written in the programming language c 
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float CylinderVolume (float Radius, float Height) 


{ float Volume; 


Declare a 
local variable 
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Volume = 3.14 * Radius * Radius * Height, - 



Compute the volume of 
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return Volume; 


} 



Terminate the function and 
return the value of the 
variable Volume. 
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Event-Driven Software Systems 

In the text, we have considered cases in which procedures are activated as the 
resuit of statements elsewhere in the program that explicitly call the procedure. 
There are cases, however, in which procedures are activated implicitly by the 
occurrence of an event. Examples are found in GUIs where the procedure that 
describes what should happen when a button is clicked is not activated by a call 
from another program unit, but instead is activated as the result of the button 
being clicked. Software systems in which procedures are activated by events 
rather than explicit requests are called event-driven systems. In short, an 
event-driven software system consists of procedures that describe what should 
happen as the result of various events. When the system is executed, these pro- 
cedures lie dormant until their respective event occurs-fhen they become 
active, perform their task, and return to dormancy. 


somewhat verbose version for pedagogical reasons.) When called, the function receives 
specific values for the formal parameters Radius and Height and returns the result 
of computing the volume of a cylinder with those dimensions. Thus the function 
could be used elsewhere in the program in a statement such as 

Cost = CostPerVolUnit * Cylinder Volume [ 3 . 45 , 12.7); 

to determine the cost of the contents of a cylinder with radius 3.45 and height 12.7. 


Questions 
& Exercises 


1. What is the difference between a global variable and a local variable? 

2 What is the difference at IftMUCtion? 

3 Why do rflkaiay programming languages implement 1/ O operations as if they 
were calls to procedures? 

4 What is the difference bdfcween £3ari)orimdli7paitamaturciardlcUii actual parameter? 

5. when writing in modem programming languages, programmers tend to use 
verbs for names of procedures and nouns for names of functions. Why? 


6.4 Language Implementation 

In this section we investigate the process of converting a program written in a high- 
level language into a machine-executable form. 


The Translation Process 

The process of converting a program from one language to another is called transla- 
tion. The program in its original form is the source program; the translated version 
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is the object program. The translation process consists of three activities-lexical 
analysis, parsing, and code generation-that are performed by units in the translator 
Known as the lexical analyzer, parser, and code generator (Figure 6.14). 

Lexical analysis is the process of recognizing which strings of symbols from the 
source program represent a single entity. For example, the three symbols 153 should 
not be interpreted as a 1, a 5, and a 3 but should be recognized as representing a sin- 
gle numeric value. Likewise, a word appearing in the program, although composed of 
individual symbols, should be interpreted as a single unit. Most humans perform lex- 
ical analysis with little conscious effort. When asked to read aloud, we pronounce 
words rather than individual characters. 

Thus the lexical analyzer reads the source program symbol by symbol, identifying 
which groups of symbols represent single units, and classifying those units according 
to whether they are numeric values, words, arithmetic operators, and so on. As each unit 
is classified, the lexical analyzer encodes the unit and its classification in a package 
known as a token and hands the token to the parser. During this process, the lexical ana- 
lyzer skips over all comment statements. 

Thus the parser views the program in terms of lexical units (tokens) rather than 
individual symbols. It is the parser's job to group these units into statements. Indeed, 
parsing is the process of identifying the grammatical structure of the program and 
recognizing the role of each component. It is the technicalities of parsing that cause 
one to hesitate when reading the sentence 

The man the horse that won the race threw was not hurt. 

(Try this one: "That that is is. That that is not is not. That that is not is not that 
that is." !) 

To simplify the parsing process, early programming languages insisted that each 
program statement be positioned in a particular manner on the printed page. Such lan- 
guages were known as fixed-format languages. Today, most programming languages 
are free-format languages, meaning that the positioning of statements is not criti- 
cal. The advantage of free-format languages lies in a programmer's ability to organ- 
ize the written program in a way that enhances readability from a human's point of 
view. In these cases it is common to use indentation to help a reader grasp the struc- 
ture of a statement. Rather than writing 

if Cost < CashOnHand then pay with cash else use 
credit card 

Figure 6.14 The translation process 
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implementation of Java 

In the case of an animated Web page, the software that controls the animation 
is transferred across the Internet along with the page. If this software is sup- 
plied in source program form, additional delays will result in viewing the page 
because the software will have to be translated into the proper machine lan- 
guage before it is executed. However, supplying the software in machine-lan- 
guage form would mean that a different version of the software would have to 
be provided depending on the machine language used by the client computer. 

Sun Microsystems has resolved this problem by designing a universal 
"machine language" called bytecode into which Java source programs can be 
translated. Although bytecode is not really a machine language, it can be exe- 
cuted quickly by any machine using an appropriate interpreter. Such inter- 
preters are a standard part of today's browser software. Thus if the software for 
controlling a Web page is written in Java and translated into bytecode, then this 
bytecode version can be transferred to the browsers viewing the Web page 
where they can provide efficient animation. 


a programmer might write 

if Cost < CashOnHand 
then pay with cash 
else use credit card 

For a machine to parse a program written in a free-format language, the syntax 
of the language must be designed so that the structure of a program can be identified 
regardless of the spacing used in the source program. To this end, most free-format 
languages use punctuation marks such as semicolons to mark the ends of statements, 
as well as key words such as i E, then, and else to mark the beginning of individ- 
ual phrases. These key words are often reserved words, meaning that they cannot 
be used by the programmer for other purposes within the program. 

The parsing process is based on a set of rules that define the syntax of the pro- 
gramming language. Collectively, these rules are called a grammar. One way of 
expressing these rules is by means of syntax diagrams, which are pictorial repre- 
sentations of a program's grammatical Structure. Figure 6.15 shows a syntax dia- 


Figure6.15 A syntax diagram of our if-ihen-else pseudocode statement 
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gram of the if-then-else statement from our pseudocode in Chapter 5. This diagram 
indicates that an if-then-else structure begins with the word if, followed by a Boolean 
expression, followed by the word then, followed by a Statement. This combination 
might or might not be followed by the word else and a Statement. Notice that terms 
that actually appear in an if-then-else statement are enclosed in ovals, whereas terms 
that require further description, such as Boolean expression and Statement, are 
enclosed in rectangles. Terms that require further description (those in rectangles) 
are called nonterminals; terms that appear in ovals are called terminals. 1 n a com- 
plete description of a language's syntax the nonterminals are described by addi- 
tional diagrams. 

As a more complete example. Figure 6.16 presents a set of syntax diagrams that 
describes the syntax of a structure called Expression, which is intended to be the struc- 
ture of simple arithmetic expressions. The first diagram describes an Expression as 
consisting of a Term that might or might not be followed by either a + or - symbol fol- 
lowed by another Expression. The second diagram describes a Term as consisting of 
either a single Factor or a Factor followed by a x or + symbol, followed by another 
Term. Finally, the last diagram describes a Factor as one of the symbols x, y, or z. 


Figure6.16 Syntax diagrams describing the structure of a simple algebraic expression 
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The manner in which a particular string conforms to a set of syntax diagrams 
can be represented in a pictorial form by a parse tree, as demonstrated in Figure 
617, which presents a parse tree for the string 

x + y x z 

based on the set of diagrams in Figure 6.16. Note that the tree starts at the top with the 
nonterminal Expression and at each level shows how the nonterminals at that level 
are decomposed until the symbols in the string itself are obtained. In particular, the fig- 
ure shows that (according to the first diagram in Figure 6.16) an Expression can be 
decomposed as a Term, followed by the + symbol, followed by an Expression. In turn, 
the Term can be decomposed (using the second diagram in Figure 6.16) as a Factor 
(which turns out to be the symbol x), and the final Expression can be decomposed 
(using the third diagram in Figure 6.16) as a Tbrm (which turns out to be y x z) . 

The process of parsing a program is essentially that of constructing a parse tree 
for the source program. Indeed, a parse tree represents the parser's interpretation of 
the program's grammatical composition. For this reason the syntax rules describing 
a program's grammatical structure must not allow two distinct parse trees for one 
string, since this would lead to ambiguities within the parser. A grammar that does 
allow two distinct parse trees for one string is said to be an ambiguous grammar. 


Figure 6.1 7 The parse tree for the string x + yxz based on the syntax diagrams in Figure 6. 16 
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Ambiguities in grammars can be quite subtle. In fact, the rule in Figure 6.15 con- 
tains such a flaw. It allows both the parse trees in Figure 6.18 for the single statement 

if Bl then if B2 then SI else 52 


Figure 6.18 Two distinct parse trees for the statement if Bl then if B2 then SI elseS2 
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Note that these interpretations are significantly different. The first implies that state- 
ment S2 is to execute ifBl is false; the second implies that S2 is to execute only if Bl 
is true and B2 is false. 

The syntax definitions of formal programming languages are designed to avoid 
such ambiguities. In our pseudocode we avoid such problems by using parentheses. 
In particular, we might write 

if Bl 

then (if B2 then SI) 
else S2 


and 

if Bl 

then (if B2 then SI 
else S2) 

to distinguish between the two possible interpretations. 

As a parser analyzes the grammatical structure of a program, it is able to identify 
individual statements and to distinguish between the declarative statements and 
imperative statements. As it recognizes the declarative statements, it records the infor- 
mation being declared in a table called the symbol table. Thus the symbol table con- 
tains such information as the names of the variables appearing in the program as well 
as what data types and data structures are associated with those variables. The parser 
then relies on this information when analyzing imperative statements such as 

z <— x + y ; 

In particular, to determine the meaning of the symbol +, the parser must know the 
data type associated with x and y. Ifx is of type real and y is of type character, then 
adding x and y makes little sense and should be reported as an error. Ifx and y are 
both of type integer, then the parser will request that the code generator build a 
machine-language instruction using the machine's integer addition op-code; ifboth 
are of type real, the parser will request that floating-point addition op-code be used; 
or if both are of type character, the parser might request that the code generator build 
the sequence of machine-language instructions needed to perform the concatena- 
tion operation. 

A somewhat special case arises ifx is of type integer andy is of type real. Then 
the concept of addition is applicable but the values aTe not encoded in compatible 
forms. In this case the parser might choose to have the code generator build the 
instructions to convert one value to the other type and then perform the addition. 
Such implicit conversion between types is called coercion. 

Coercion is frowned upon by many language designers. They argue that the need 
for coercion usually indicates a flaw in the program's design and therefore should not 
be accommodated by the parser. The result is that most modern languages are 
strongly typed, which means that all activities requested by a program must involve 
data of agreeable types without coercion. Parsers for these languages report all type 
conflicts as errors. 
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The final activity in the translation process is code generation, which is the 
process of constructing the machine-language instructions to implement the statements 
recognized by the parser. This process involves numerous issues, one being that of pro- 
ducing efficient machine-language versions of programs. For example, consider the 
task of translating the two- statement sequence 

x y + z; 

W <— X + Z ; 

If these statements are translated as individual statements, each would require that 
data be transferred from main memory into the CPU before the indicated addition 
takes place. However, efficiency can be gained by recognizing that once the first state- 
ment has been executed, the values of x and z will already be in the CPU’s general- 
purpose registers and therefore need not be loaded from memory before performing 
the second addition. Implementing insights such as this is called code optimization 
and is an important task of the code generator. 

Finally, we should note that the steps oflexical analysis, parsing, and code gen- 
eration are not carried out in a strict sequential order. Instead, these activities are 
intertwined. The lexical analyzer begins by reading characters from the source pro- 
gram and identifying the first token. It hands this token to the parser. Each time the 
parser receives a token from the lexical analyzer, it analyzes the grammatical struc- 
ture being read. At this point it might request another token from the lexical analyzer 
or, if the parser recognizes that a complete phrase or statement has been read, it calls 
on the code generator to produce the proper machine instructions. Each such request 
causes the code generator to build machine instructions that are added to the object 
program. In turn, the task of translating a program from one language to another con- 
forms naturally to the object-oriented paradigm. The source program, lexical ana- 
lyzer, parser, code generator, and object program are objects that interact by sending 
messages back and forth as each object goes about performing its task (Figure 6.19). 

Figure 6.19 An object-oriented approach to the translation process 
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Software Development Packages 

The software tools, such as editors and translators, used in the software development 
process are often grouped into a package that functions as one integrated software devel- 
opment system. Such a system would be classified as application software in the clas- 
sification scheme of Section 3.2. By using this application package, a programmer gains 
ready access to an editor for writing programs, a translator for converting the programs 
into machine language, and a variety of debugging tools that allow the programmer to 
trace the execution of a malfunctioning program to discover where it goes astray. 

The advantages of using such an integrated system are numerous. Perhaps the 
most obvious is that a programmer can move back and forth between the editor and 
debugging tools with ease, as changes to the program are made and tested. Moreover, 
many software development packages allow related program units that are under 
development to be linked in such a way that access to related units is simplified. Some 
packages maintain records regarding which program units within a group of related 
units have been altered since the last benchmark was made. Such capabilities are 
quite advantageous in the development of large software systems in which many 
interrelated units are developed by different programmers. 

On a smaller scale, the editors in software development packages are often cus- 
tomized to the programming language being used. Such an editor will usually pro- 
vide automatic line indentation that is the de facto standard for the target language 
and in some cases might recognize and automatically complete key words after the 
programmer has typed only the first few characters. Moreover, the editor might high- 
light keywords within source programs (perhaps with color) so that they stand out, 
making the programs easier to read. 

In the next chapter we will learn that software developers are increasingly search- 
ing for ways by which new software systems can be constructed from prefabricated 
blocks called components-leading to a new software development model called com- 
ponent architecture. Software development packages based on the component archi- 
tecture model often use graphical interfaces in which components can be represented 
as icons on the monitor screen. In this setting a programmer (or component assem- 
bler) selects desired components with a mouse. A selected component can then be cus- 
tomized by means of the package's editor and then attached to other components by 
pointing and clicking with the mouse. Such packages represent a major step forward 
in the search for better software development tools. 


Questions 
& Exercises 


Describe the three major steps in the translation process. 
2 . What is a symbol table? 

Draw the parse tree for the expression 

x x y + x + z 

based on the syntax diagrams in Figure 6.16. 
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4 . Describe the strings that conform to the structure Chacha according to the 
following syntax diagrams. 

Chacha: 





6.5 Object-Oriented Programming 

In Sectioned we learned that the object-oriented paradigm entails the development 
of active program units called objects, each of which contains procedures describing 
how that object should respond to various stimuli. The object-oriented approach to a 
problem is to identify the objects involved and describe them as self-contained units. 
In turn, object-oriented programming languages provide statements for describing 
objects and their behavior. In this section we will introduce some of these statements 
as they appear in the languages C + + , Java, and C#, which are three of the more 
prominent object-oriented languages used today. 


Classes and Objects 

Consider the task of developing a simple computer game in which the player must 
protect the Earth from falling meteors by shooting them with high-power lasers. Each 
laser contains a finite internal power source that is partially consumed each time the 
laser is fired. Once this source is depleted, the laser becomes useless. Each laser 
should be able to respond to the commands to aim farther to the right, aim farther to 
the left, and to fire its laser beam. 

In the object-oriented paradigm, each laser in the computer game would be imple- 
mented as an object that contains a record of its remaining power as well as proce- 
dures for modifying its aim and firing its laser beam. Since all the laser objects have 
the same properties, they can be described by means of a common template. In the 
object-oriented paradigm a template for a collection of objects is called a class. 
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In Chapter 8, we will explore the similarities between classes and data types. For 
now we simply note that a class describes the common characteristics of a collection 
of objects in much the same way as the concept of the primitive data type integer 
encompasses the common characteristics of such numbers as 1, 5, and 82. Once a 
programmer has included the description of a class in a program, that template can 
be used to construct and to manipulate objects of that "type" in much the same way 
that the primitive type integer allows the manipulation of "objects" of type integer. 

In the languages C+ + , Java, and C# a class is described by a statement of the form 

class Name 


} 

where Name is the name by which the class can be referenced elsewhere in the pro- 
gram. It is within the braces that the properties of the class are described. In partic- 
ular, a class named LaserClass describing the structure of a laser in our computer 
game is outlined in Figure 6.20. The class consists of the declaration of a variable 
named RemainingPower (oftype integer) and three procedures named turnRight, 
turnLeft, and fire. These procedures describe the routines to be performed to 
accomplish the corresponding action. Thus any object that is constructed from this 
template will have these features: a variable called RemainingPower and three pro- 
cedures named turnRight, turnLeft, and fire. 


Figure 6.20 The structure of a class describing a laser weapon in a computer game 
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A variable that resides within an object, such as RemainingPower, is called an 
instance variable and the procedures within an object are called methods (or mem- 
ber functions in the C + + vernacular). Note that in Figure 6.20 the instance variable 
RemainingPower is described using a declaration statement similar to those discussed 
in Section 6.2 and the methods are described in a form reminiscent of procedures and 
functions as discussed in Section 6.3. After all, declarations of instance variables and 
descriptions of methods are basically imperative programming concepts. 

Once we have described the class LaserClass in our game program, we can 
declare three variables Laserl , Laser2, and Laser3 to be of "type" LaserClass by 
a statement of the form 

LaserClass Laserl, Laser2, Laser3; 

Note that this is the same format as the statement 

i n t x , y , z ; 

that would be used to declare three variables named x, y, and z of type integer, as we 
learned early in Section 6.2. Both consist of the name of a "type" followed by a list of 
the variables being declared. The difference is that the latter statement says that the 
variable x will be used in the program to refer to an item of type integer (which is a 
primitive type), whereas the former statement says the variable Laserl will be used 
in the program to refer to an item of "type" LaserClass (which is a "type" defined 
within the program). 

Once we have declared the variables Laserl, Laser2, and Laser3 to be of "type" 
LaserClass, we can assign them values. In this case the values must be objects that con- 
form to the "type" LaserClass. These assignments can be made by assignment state- 
ments, but it is often convenient to assign starting values to the variables within the same 
declaration statements used to declare the variables. Such initial assignments are made 
automatically in the case of declarations in the language C++. That is, the statement 

LaserClass Laserl, Laser2, Laser3; 

not only establishes the variables Laserl, Laser2, and Laser 3, but also creates three 
objects of "type" LaserClass, one as the value of each variable. In the languages Java 
and C*, such initial assignments are instigated in much the same way that initial assign- 
ments are made to variables of primitive types. In particular, whereas the statement 

i nt x = 3 ; 

not only declares x to be a variable of type integer but also assigns the variable the 
value 3, the statement 

LaserClass Laserl = new LaserClassO; 

declares the variable Laserl to be of "type" LaserClass and also creates a new object 
using the LaserClass template and assigns that object as the starting value ofLaserl. 

At this point we should pause to emphasize the distinction between a class and 
an object. A class is a template from which objects are constructed. One class can be 
used to create numerous objects. We often refer to an object as an instance of the class 
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from which it was constructed. Thus, in our computer game Laserl, Laser2, and 
Laser 3 are variables whose values are instances of the class LaserClass. 

After using declarative statements to create the variables Laserl, Laser 2, and 
Laser 3 and assign objects to them, we can continue our game program by writing 
imperative statements that activate the appropriate methods within these objects (in 
object-oriented vernacular, this is called sending messages to the objects). In partic- 
ular, we could cause the object assigned to the variable Laserl to execute its fire 
method using the statement 

Laserl. fireO ; 

Or we could cause the object assigned to Laser2 to execute its turnLeft method via 
the statement 

L a s e r 2 . turnLeftQ ; 

These are actually little more than procedure calls. Indeed, the former statement is 
a call to the procedure (the method) fire inside the object assigned to the variable 
Laserl, and the latter statement is a call to the procedure turnLeft inside the object 
assigned to the variable Laser 2. 

Constructors 

When an object is constructed, often some customizing activities need to be per- 
formed. For example, in our meteor computer game we might want the different 
lasers to have different initial power settings, which would mean that the instance 
variables named RemainingPo wer within the various objects should be given dif- 
ferent starting values. Such initialization needs are handled by defining special 
methods, called constructors, within the appropriate class. Constructors are exe- 
cuted automatically when an object is constructed from the class. A constructor is 
identified within a class definition by the fact that it is a method with the same 
name as the class. 

Figure 6.21 presents an extension of the LaserClass definition originally shown 
in Figure 6.20. Note that it contains a constructor in the form of a method named Laser- 
Class. This method assigns the instance variable RemainingPo wer the value it receives 
as its parameter. Thus, when an object is constructed from this class, this method will 
be executed, causing RemainingPower to be initialized at the appropriate setting. 

The actual parameters to be used by a constructor are identified in a parameter 
list in the statement causing the creation of the object. Thus, based on the class def- 
inition in Figure 6.21, a C ++ programmer would write 

LaserClass Laserl(50), Laser2{ 100); 

to create two objects of type LaserClass-one known as Laserl with an initial 
power reserve of50, the other known as Laser2 with an initial power reserve of 100. 
Java and C# programmers would accomplish the same task with the statements 

LaserClass Laserl = new L a s e r C 1 a s s ( 5 0 ) ; 

LaserClass Laser2 = new L a s e r C 1 a s s ( 1 0 0 ) ; 


6.5 Object-Oriented Programming 


Figure 6.21 A class with a constructor 
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Additional Features 

Let us now suppose we want to enhance our meteor computer game so that a player 
who reaches a certain score will be rewarded by recharging some of the lasers to their 
original power setting. These lasers will have the same properties as the other lasers 
except that they will be rechargeable. 

To simplify the description of objects with similar yet different characteristics, 
object-oriented languages allow one class to encompass the properties of another 
through a technique known as inheritance. As an example, suppose we were using 
Java to develop our game program. We could first use the class statement described 
previously to define a class called LaserClass that described those properties that 
are common to all lasers in the program. Then we could use the statement 

class RechargeableLaser extends LaserClass 


} 

to describe another class called RechargeableLaser. (C + + and C# programmers 
would merely replace the word extends with a colon.) Here the extends clause indi- 
cates that this class is to inherit the features of the class LaserClass as well as contain 
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those features appearing within the braces. In our case, these braces would contain a new 
method (perhaps named recharge) that would describe the steps required to reset the 
instance variable RemainingPo wer to its original value. Once these classes were 
defined, we could use the statement 

LaserClass Laserl, Laser2; 

to declare Laserl and Laser 2 to be variables referring to traditional lasers, and use 
the statement 

RechargeableLaser Laser3, Laser4; 

to declare Laser3 and Laser4 to be variables referring to lasers having the addi- 
tional properties described in the RechargeableLaser class. 

The use of inheritance leads to the existence of a variety of objects with similar 
yet different characteristics, which in turn leads to a phenomenon reminiscent of 
overloading, which we met in Section 6.2. (Recall that overloading refers to the use 
of a single symbol, such as +, for representing different operations depending on the 
type of its operands.) Suppose that an object-oriented graphics package consists of a 
variety of objects, each representing a shape (circle, rectangle, triangle, and so on). A 
particular image might consist of a collection of these objects. Each object "knows" its 
size, location, and color as well as how to respond to messages telling it, for example, 

Figure 6.22 Our LaserClass definition using encapsulation as if would appear in a Java or C# program 
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to move to a new location or to draw itself on the monitor screen. To draw an image, 
we merely send a "draw yourselP message to each object in the image. However, the 
routine used to draw an object varies according to the shape of the object-drawing a 
square is not the same process as drawing a circle. This customized interpretation of 
a message is known as polymorphism; the message is said to be polymorphic. 

Another characteristic associated with object-oriented programming is encap- 
sulation, which refers to restricting access to an object's internal properties. To say 
that certain features of an object are encapsulated means that only the object itself is 
able to access them. Features that are encapsulated are said to be private. Features that 
are accessible from outside the object are said to be public. 

As an example, let us return to our LaserClass originally outlined in Figure 
6.20. Recall that it described an instance variable RemainingPo wer and three meth- 
ods turnRight, turnLeft, and fire. These methods are to be accessed by other 
program units to cause an instance of LaserClass to perform the appropriate action. 
But the value of RemainingPower should only be altered by the instance's internal 
methods. No other program unit should be able to access this value directly. To enforce 
these rules we need merely designate RemainingPower as private and turnRight, 
turnLeft, and fire as public as shown in Figure 6.22. With these designations 
inserted, any attempt to access the value of RemainingPower from outside the object 
in which it resides will be identified as an error when the program is translated- 
forcing the programmer to correct the problem before proceeding. 


1 . What is the difference between an object and a class? 

2 What classes of objects other than LaserClass might be found in the com- 
puter game example used in this section? What instance variables in addition 
to RemainingPower might be found in the class LaserClass? 

3 Suppose the classes PartTimeEmployee and FullTimeEmploy ee inherited 
the properties of the class Employee. What are some features that you might 
expect to find in each class? 

4. What is a constructor? 

5 Why are some items within a class designated as private? 


Questions* 
& Exercise* 


6.6 Programming Concurrent Activities 

Suppose we were asked to design a program to produce animation for an action computer 
game involving multiple attacking enemy spaceships. One approach would be to design 
a single program that would control the entire animation screen. Such a program would 
be charged with drawing each of the spaceships, which (if the animation is to appear real- 
istic) would mean that the program would have to keep up with the individual charac- 
teristics of numerous spacecraft. An alternate approach would be to design a program 
to control the animation of a single spaceship whose characteristics are determined by 
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parameters assigned at the beginning of the program’s execution. Then the animation 
could be constructed by creating multiple activations of this program, each with its own 
set of parameters. By executing these activations simultaneously, we could obtain the 
illusion of many individual spaceships streaking across the screen at the same time. 

Such simultaneous execution of multiple activations is called parallel processing 
or concurrent processing. True parallel processing requires multiple CPUs, one to exe- 
cute each activation. When only one CPU is available, the illusion of parallel process- 
ing is obtained by allowing the activations to share the time of the single processor in 
a manner similar to that implemented by time-sharing operating systems (Chapter 3). 

Many modem computer applications are more easily solved in the context of par- 
allel processing than in the more traditional context involving a single sequence of 
instructions. In turn, newer programming languages provide syntax for expressing 
the semantic structures involved in parallel computations. The design of such a lan- 
guage requires the identification of these semantic structures and the development 
of a syntax for representing them. 

Each programming language tends to approach the parallel processing paradigm 
from its own point of view, resulting in different terminology. For example, what we 
have informally referred to as an activation is called a task in the Ada vernacular and 
a thread in Java. That is, in an Ada program, simultaneous actions are performed by 
creating multiple tasks, whereas in Java one creates multiple threads. In either case, 
the result is that multiple activities are generated and executed in much the same 
way as processes under the control of a multitasking operating system. We will adopt 
the Java terminology and refer to such "processes" as threads. 

Perhaps the most basic action that must be expressed in a program involving par- 
allel processing is that of creating new threads. If we want multiple activations of the 
spaceship program to be executed at the same time, we need a syntax for saying so. 
Such spawning of new threads is similar to that of requesting the execution of a tra- 
ditional procedure. The difference is that, in the traditional setting, the program unit 
that requests the activation of a procedure does not progress any further until the 
requested procedure terminates (recall Figure 6.9), whereas in the parallel context the 
requesting program unit continues execution while the requested procedure performs 
its task (Figure 6.23). Thus to create multiple spaceships streaking across the screen, 
we would write a main program that simply generates multiple activations of the 
spaceship program, each provided with the parameters describing the distinguishing 
characteristics of that spaceship. 

A more complex issue associated with parallel processing involves handling com- 
munication between threads. For instance, in our spaceship example, the threads rep- 
resenting the different spaceships might need to communicate their locations among 
themselves in order to coordinate their activities. In other cases one thread might need 
to wait until another reaches a certain point in its computation, or one thread might 
need to stop another one until the first has accomplished a particular task. 

Such communication needs have long been a topic of study among computer sci- 
entists, and many newer programming languages reflect various approaches 
to thread interaction problems. As an example, let us consider the communication 
problems encountered when two threads manipulate the same data. (This example is 
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Figure 6.23 Spawning threads 
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presented in more detail in the optional Section 3.4.) If each of two threads that are exe- 
cuting concurrently need to add the value three to a common item of data, a method 
is needed to ensure that one thread is allowed to complete its transaction before the 
other is allowed to perform its task. Otherwise they could both start their individual 
computations with the same initial value, which would mean that the final result would 
be incremented by only three rather than six. Data that can be accessed by only one 
thread at a time is said to have mutually exclusive access. 

One approach to solving this problem is to write the program units that describe 
the threads involved so that when a thread is using shared data, it blocks other threads 
from accessing that data until such access is safe. (This is the approach described in 
the optional Section 3.4, where we identified the portion of a process that accesses 
shared data as a critical region.) Experience has shown that this approach has the draw- 
back of distributing the task of ensuring mutual exclusion throughout various parts of 
the program-each program unit accessing the data must be properly designed to 
enforce mutual exclusion, and thus a mistake in a single segment can corrupt the 
entire system. For this reason many argue that a better solution is to embody the data 
item with the ability to control access to itself. In short, instead of relying on the threads 
that access the data to guard against multiple access, the data item itself is assigned this 
responsibility. The result is that control of access is concentrated at a single point in 
the program rather than dispersed among many program units. A data item augmented 
with the ability to control access to itself is often called a monitor. 

We conclude that the design of programming languages for parallel processing involves 
developing ways to express such things as the creation of threads, the pausing and restart- 
ing of threads, the identification of critical regions, and the composition of monitors. 
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In closing, we should note that although animation provides an interesting set- 
ting in which to explore the issues of parallel computing, it is only one of many fields 
that benefit from parallel processing techniques. Other areas include weather fore- 
casting, air traffic control, simulation of complex systems (from nuclear reactions to 
pedestrian traffic), computer networking, and database maintenance. 


Questions 
& Exercises 


1. what are some properties that would be found in a programming language for 
concurrent processing that would not be found in a more traditional language? 

2 Describe two methods for insuring mutually exclusive access to data. 

3 . Identify some settings other than animation in which parallel computing is 
beneficial. 


6.7 Declarative Programming 

In Section 6.1 we claimed that formal logic provides a general problem-solving algo- 
rithm around which a declarative programming system can be constructed. In this sec- 
tion we investigate this claim by first introducing the rudiments of the algorithm and 
then taking a brief look at a declarative programming language based on it. 


Logical Deduction 

Suppose we know that either Kermit is on stage or Kermit is sick, and we are told that 
Kermit is not on stage. We could then conclude that Kermit must be sick. This is an 
example of a deductive-reasoning principle called resolution. Resolution is one of 
many techniques, called inference rules, for deriving a consequence from a collec- 
tion of statements. 

To better understand resolution, let us first agree to represent simple statements 
by single letters and to indicate the negation of a statement by the symbol -.. For 
instance, we might represent the statement "Kermit is a prince" by A and "Miss Piggy 
is an actress" by B. Then, the expression 

A OR B 

would mean "Kermit is a prince or Miss Piggy is an actress" and 
B AND - A 

would mean "Miss Piggy is an actress and Kermit is not a prince." We will use an 
arrow to indicate "implies." For example, the expression 

A -» B 

means "Kermit is a prince implies that Miss Piggy is an actress." 

In its general form, the resolution principle states that from two statements of the 

form 
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POR q. 

and 


R OR -• Q 

we can conclude the statement 
PORR 

In this case we say that the two original statements resolve to form the third statement, 
which we call the resolvent. It is important to observe that the resolvent is a logical con- 
sequence of the original statements. That is, if the original statements are true, the 
resolvent must also be true. (If Q is true, then £ must be true; but if Q. is false, then P 
must be true. Thus regardless of the truth or falseness of Q, either For R must be true.) 

We will represent the resolution of two statements pictorially as shown in Figure 6.24, 
where we write the original statements with lines projecting down to their resolvent. Note 
that resolution can be applied only to pairs of statements that appear in clause form- 
that is, statements whose elementary components are connected by the Boolean oper- 
ation OR. Thus 

P OR Q. 

is in clause form, whereas 
P -» Q 

is not. The fact that this potential problem poses no serious concern is a consequence 
of a theorem in mathematical logic that states that any statement expressed in the first- 
order predicate logic (a system for representing statements with extensive expressive 
powers) can be expressed in clause form. We will not pursue this important theorem 
here, but for future reference we observe that the statement 

P A Oi 


is equivalent to the clause form statement 
Q OR -.P 

A collection of statements is said to be inconsistent if it is impossible for all the 
statements to be true at the same time. In other words, an inconsistent collection of 

Figure 6.24 Resolving the statements (P OR Q) and (p OR -> Q) to produce (P OR R) 


PORQ ffOR-.Q 



POR R 
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statements is a collection of statements that are self-contradictory. A simple example 
would be a collection containing the statement P as well as the statement - P. Logicians 
have shown that repeated resolution provides a systematic method of confirming the 
inconsistency of a set of inconsistent clauses. The rule is that if repeated application 
of resolution produces the empty clause (the result of resolving a clause of the form P 
with a clause of the form - P), then the original collection of statements must be incon- 
sistent. As an example. Figure 6.25 demonstrates that the collection of statements 

PORQ KOR-'Q - i ] ? -P 

is inconsistent. 

Suppose now that we want to confirm that a collection of statements implies the 
statement P. To imply the statement P is the same as contradicting the statement - P. 
Thus, to demonstrate that the original collection of statements implies P, all we need 
to do is apply resolution to the original statements together with the statement ->P 
until an empty clause occurs. Upon obtaining an empty clause, we can conclude that 
statement - P is inconsistent with the original statements, and thus the original state- 
ments must imply P. 

One final point remains before we are ready to apply resolution in an actual pro- 
gramming environment. Suppose we have the two statements 

(Mary is at X) -> (Mary's lamb is at X) 

where X represents any location and 

Mary is at home 

In clause form the two statements become 

(Mary's lamb is at X) OR -.{Mary is at X) 


Figure 6.25 Resolving the statements (POR Q ), (/? OR -»Q), -•/?, and -»P 



empty clause 
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and 


(Mary ‘is at home) 

which at first glance do not have components that can be resolved. On the other hand, 
the components (Mary is at home) and - (Mary is at X) are quite close to being 
oppositesofeach other. The problem is to recognize that Mary is at X, being a state- 
ment about locations in general, is a statement about home in particular. Thus a spe- 
cial case of the first statement is 

(Mary's lamb is at home) OR -.(Mary is at home) 

which can be resolved with the statement 

(Mary is at home) 

to produce the statement 

(Mary's lamb is at home) 

The process of assigning values to variables (such as assigning the value home to X) 
so that resolution can be performed is called unification. It is this process that allows 
general statements to be applied to specific applications in a deduction system. 

Prolog 

The programming language Prolog (short for PROgramming in LOGic) is a declarative 
programming language whose underlying problem-solving algorithm is based on 
repeated resolution. Such languages are called logic programming languages. A pro- 
gram in Prolog consists of a collection of initial statements to which the underlying 
algorithm applies its deductive reasoning. The components from which these state- 
ments are constructed are called predicates. A predicate consists of a predicate iden- 
tifier followed by a parenthetical statement listing the predicate's arguments. A single 
predicate represents a fact about its arguments, and its identifier is usually chosen to 
reflect this underlying semantics. Thus if we want to express the fact that Bill is Mary's 
parent, we can use the predicate form 

parent(bill, mary) 

Note that the arguments in this predicate start with lowercase letters, even though 
they represent proper nouns. This is because Prolog distinguishes arguments that are 
constants from arguments that are variables by insisting that constants begin with low- 
ercase letters and variables begin with uppercase letters. (Here we have used the ter- 
minology of the prolog culture where the term constant is used in place of the more 
generic term literal More precisely, the term bill (note the lowercase) is used in 
prolog to represent the literal that might be represented as "Bill" in a more generic 
notation. The term Bill (note the uppercase) is used in prolog to refer to a variable.) 

Statements in a Prolog program are either facts or rules, each of which is termi- 
nated by a period. A fact consists of a single predicate. For example, the fact that a tur- 
tle is faster than a snail could be represented by the Prolog statement 
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f a s t e r ( t u r 1 1 e , snail). 

and the fact that a rabbit is faster than a turtle could be represented by 
f a s t e r ( r a b b i t , turtle). 

A Prolog rule is an "implies" statement. However, instead of writing such a state- 
ment in the form X -> Y, a Prolog programmer writes " Y if X," except that the symbol 
(a colon followed by a dash) is used in place of the word if. Thus the rule "X is old 
implies X is wise" might be expressed by a logician as 

old(X) — > wise(X) 

but would be expressed in Prolog as 

wise(X) old(X). 

As another example, the rule 

(faster(X, Y) AND faster(Y, Z)) -» faster(X, Z) 

would be expressed in Prolog as 

faster(X, Z) faster(X, Y), fasterfY, Z). 

The comma separating faster (x, Y) and faster [Y, Z) represents the conjunc- 
tion AND . Although rules such as these are not in clause form, they are allowed in Pro- 
log because they can be easily converted into clause form. 

Keep in mind that the Prolog system does not know the meaning of the predicates 
in a program; it simply manipulates the statements in a totally symbolic manner 
according to the resolution inference rule. Thus it is up to the programmer to describe 
all the pertinent features of a predicate in terms of facts and rules. In this light, Pro- 
log facts tend to be used to identify specific instances of a predicate, whereas rules are 
used to describe general principles. This is the approach followed by the preceding 
statements regarding the predicate faster. The two facts describe particular instances 
of "fastemess" while the rule describes a general property. Note that the fact that a rab- 
bit is faster than a snail, though not explicitly stated, is a consequence of the two facts 
combined with the rule. 

When developing software using Prolog, the task of a programmer is to develop 
the collection of facts and rules that describe the information that is known. These 
facts and rules constitute the set of initial statements to be used in the deductive 
system. Once this collection of statements is established, conjectures (called goals in 
Prolog terminology) can be proposed to the system-usually by typing them at a 
computer's keyboard. When such a goal is presented to a Prolog system, the system 
applies resolution to try to confirm that the goal is a consequence of the initial state- 
ments. Eased on our collection of statements describing the relationship faster, 
each of the goals 

f a s t e r ( t u r 1 1 e , snail), 
f a s t e r t r ab b i t , turtle), 
f a s t er f r ab b i t , snail). 
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could be so confirmed because each is a logical consequence of the initial statements. 
The first two are identical to facts appearing in the initial statements, whereas the 
third requires a certain degree of deduction by the system. 

More interesting examples are obtained if we provide goals whose arguments are 
variables rather than constants. In these cases Prolog tries to derive the goal from the 
initial statements while keeping track of the unifications required to do so. Then, if 
the goal is obtained, Prolog reports these unifications. For example, consider the goal 

faster (W, snail) . 

In response to this, Prolog reports 

faster (turtle, snail) . 

Indeed, this is a consequence of the initial statements and agrees with the goal via 
unification. Furthermore, if we asked Prolog to tell us more, it finds and reports the 
consequence 

faster (rabbit, snail) . 

In contrast, we can ask Prolog to find instances of animals that arc slower than a rab- 
bit by proposing the goal 

faster (rabbit, W) . 

In fact, if we started with the goal 

faster (V, W ) . 

Prolog ultimately reports all the faster relationships that can be derived from the 
initial statements. Thus a single Prolog program can be used to confirm that a par- 
ticular animal is faster than another, to find those animals that are faster than a given 
animal, to find those animals that are slower than a given animal, or to find all faster 
relationships. This versatility is one of the features that has captured the imagination 
of computer scientists. 


1 . Which of the statements R, S, T, U, and V are logical consequences of the QlJ6StionS 
collection of statements ( - R OR T OR 5), (-5 OR V), ( - V O K R ) , (U OR -S), & ExerCISeS. 
(TOR - U), and (S OR V)? 

2. Is (the I'allllfiui itt»<atlld:ccw««n xb' f Mimmaittis taamsisteint? Essiplaiun your answer. 

PORQORK ->R ORQ ROR->P -Q 

3. Suppose a Prolog program consisted of the statements 

thri ft ier ( carol , John ) , 
thriftier (bill, sue) . 
thriftier (sue, carol) . 

thriftier (X, Z ) thriftier (X, Y) , thriftier (Y, 2). 
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List the results that can be produced from each of the following goals: 

a. thriftier ( sum,, W) . 

b. thriftier(U, carol). 

c. thriftier (U,V). 

4. Complete the two rules at the end of the Prolog program below so that the 
predicate mother (X, Y) means "X is the mother of Y" and the predicate 
father (X, Y) means "X is the father of Y." 

female(carol). 
female ( sue) . 
male(bill). 
male( John) . 
parentfjohn, carol), 
parent(sue, carol), 
mother (X , Y) :- 

father(X,Y) 
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(Asterisked problems are associated with optional sections.) 

1. What does it mean to say that a programming 
language is machine independent? 


2 Translate the following pseudocode program 
into the machine language described in 
Appendix C. 

x <— 0 ; 

while (x < 3) do 

(X cr- X + 1) 

3. Translate the statement 

Halfway «- Length + Width 

into the machine language of Appendix C, 
assuming that Length, Width, and Halfway 
are all represented in floating-point notation. 

4. Translate the high-level statement 
if (X eguals 0 ) 

then Z <- Y + W 
elseZe-Y + X 


into the machine language of Appendix C, 
assuming that W, X, Y, and Z are all values rep- 
resented in two's complement notation, each 
using one byte of memory. 

5. Why was it necessary to identify the type of 
data associated with the variables in Problem 
4 in order to translate the statements? Why do 
many high-level programming languages 
require the programmer to identify the type of 
each variable at the beginning of a program? 

6 . Name and describe four different program- 
ming paradigms. 

7 Suppose the function/expects two numeric 
values as its inputs and returns the smaller of 
the two values as its output value. Ifw, x, y, 
and z represent numeric values, what is the 
result returned byjff(wpc), f(y,z))? 

8. Suppose / is a function that returns the result of 
reversing the string of symbols given as its 
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input, and g is a function that returns the con- 
catenation of the two strings given as its input. If 
x is the string abed, what is returned by g(f(x),x)? 

9. Suppose you are going to write an object- 
oriented program for maintaining your finan- 
cial records. What data should be stored inside 
the object representing your checking 
account? To what messages should that object 
be able to respond? What are other objects that 
might be used in the program? 

1 0. Summarize the distinction between a machine 
language and an assembly language. 

1 1 . Design an assembly language for the machine 
described in Appendix C. 

12. John Programmer argues that the ability to 
declare constants within a program is not nec- 
essary because variables can be used instead. 
For example, our example ofAirportAlt in 
Section 6.2 could be handled by declaring 
AirportAlt to be a variable and then assign- 
ing it the required value at the beginning of 
the program. Why is this not as good as using 
a constant? 

13. Summarize the distinction between declara- 
tive statements and imperative statements. 

14. Explain the differences between a literal, a 
constant, and a variable. 

1 5. a. What is operator precedence? 

b. Depending on operator precedence, what 
values could be associated with the expres- 
sion 6 + 2x3? 

16. What is structured programming? 

17. What is the difference between the meaning of 
the "equals" symbol in the statement 

if ( X = 5 ) then (...) 

as opposed to the assignment statement 
X = 2 + Y 

18. Draw a flowchart representing the structure 
expressed by the following for statement. 

for (int x = 2; x < 8; + + x) 

{ . . . } 


19. Translate the following for statement into an 
equivalent program segment using the while 
statement in our pseudocode of Chapter 5. 

for (int x = 2; x < 8; + + x) 

{ . . . 1 

20. If you are familiar with written music, analyze 
musical notation as a programming language. 
What are the control structures? What is the 
syntax for inserting program comments? What 
music notation has semantics similar to the 
for statement in Figure 6.8? 

2 1 . Draw a flowchart representing the structure 
expressed by the following statement. 

switch (suit) 

{case "clubs": bid(l); 
case "diamonds": bid(2); 
case "hearts": bid(3); 
case "spades": bid(4); 

} 

22 Rewrite the following program segment using 
a single case statement instead of nested if- 
then-else statements. 

if (W = 5) 

then ( Z « - 7 ) 
else (if (W = 6) 

then ( Y « - 7) 
else (if (W = 7) 

then (X «- 7) 

) 

) 

23. Summarize the following rat's-nest routine 
with a single if-then-else statement: 

if X > 5 then goto 80 
X = X + 1 
goto 90 
80 X = X + 2 
90 stop 

24. Summarize the basic control structures found 
in imperative and object-oriented program- 
ming languages for performing each of the fol- 
lowing activities: 
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a. Determining which command should be 
executed next. 

b. Repeating a collection of commands. 

c. Changing a variable's value. 

25. Summarize the distinction between a transla- 
tor and an interpreter. 

26. Suppose the variable X in a program was 
declared to be of type integer. What error would 
occur when executing the program statement 

X <— 2 . 5 

27. What does it mean to say that a programming 
language is strongly typed? 

28. Why would a large array probably not be 
passed to a procedure by value? 

29. Suppose the procedure Modify is defined in 
our pseudocode of Chapter 5 by 

procedure Modify (Y) 

Y «- 7; 

print the value of y. 

If parameters are passed by value, what will 
be printed when the following program seg- 
ment is executed? What if parameters are 
passed by reference? 

X « - 5 ; 

apply the procedure Modify to X; 
print the value ofX; 

30. Suppose the procedure Modify is defined in 
our pseudocode of Chapter 5 by 

procedure Modify (Y) 

Y <- 9; 

print the value of X; 
print the value of Y. 

Also suppose that X is a global variable. If 
parameters are passed by value, what will be 
printed when the following program segment 
is executed? What if parameters are passed by 
reference? 

X « - 5 ; 

apply the procedure Modify to X; 
print the value of X; 


31 . Sometimes an actual parameter is passed to a 
procedure by producing a duplicate to be used 
by the procedure (as when the parameter is 
passed by value), but when the procedure is 
completed the value in the procedure's copy is 
transferred to the actual parameter before the 
calling procedure continues. In such cases the 
parameter is said to be passed by value-result. 
What would be printed by the program seg- 
ment in Problem 30 if parameters were passed 
by value-result? 

32. a . What is an advantage of passing parameters 
by value as opposed to passing them by 
reference? 

b. What is an advantage of passing parameters 
by reference as opposed to passing them by 
value? 

33 What ambiguity exists in the statement 
X <- 3 + 2 x 5 

34. Suppose a small company has five employees 
and is planning to increase the number to six. 
Moreover, suppose one of the company's pro- 
grams contained the following assignment 
statements. 

DailySalary = TotalSal/5; 

AvgSalary = TotalSal/5; 

DailySales = T o t a 1 S a 1 e s / 5 ; 

AvgSales = T o t al S al e s/ 5 ; 

How would the task of updating the program 
be simplified if the program had originally 
been written using constants named 
NumberOf Emp and Workweek (both set to the 
value 5) so that the assignment statements 
could be expressed as 

DailySalary = Totals al/DaysWk; 
AvgSalary = TotalSal/NumEmpl; 
DailySales = Total S ale s/D ay sWk ; 
AvgSales = Totals ales/NumEmpl ; 

35. a. What is the distinction between a formal 

language and a natural language? 
b. Give an example of each. 
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3 6 . Draw a syntax diagram representing the struc- 

ture of the while statement in the pseudocode 
of Chapter 5. 

37 Design a set of syntax diagrams to describe the 
syntax of telephone numbers in your locality. 
For instance, in the United States telephone 
numbers consist of an area code, followed by a 
regional code, followed by a four-digit number 
such as (444) 555-1234. 

38. Design a set of syntax diagrams to describe 
simple sentences in your native language. 

39. Design a set of syntax diagrams to describe dif- 
ferent ways of representing dates such as 
month/day/year or month day, year. 

4 0 . Design a set of syntax diagrams that describes 

the grammatical structure of "sentences" that 
consist of occurrences of the word yes fol- 
lowed by the same number of the word no. For 
example, "yes yes no no" would be such a sen- 
tence, whereas "no yes," "yes no no," and "yes 
no yes" would not. 

4 1 Give an argument to the effect that a set of 
syntax diagrams cannot be designed that 
describes the grammatical structure of "sen- 
tences" that consist of occurrences of the word 
yes, followed by the same number of occur- 
rences of the word no, followed by the same 
number of occurrences of the word maybe. For 
example, "yes no maybe" and "yes yes no no 
maybe maybe" would be such sentences, 
whereas "yes maybe," "yes no no maybe 
maybe," and "maybe no" would not. 


42. Write a sentence describing the structure of a 
string as defined by the syntax diagram below. 
Then, draw the parse tree for the string xxyxx. 


String 


String 


<z> 



4 3 . Add syntax diagrams to those in Question 4 of 
Section 6.4 to obtain a set of diagrams that 
defines the structure Dance to be either a 


Chacha or a Walt/, where a Waltz consists ol 
one or more copies of the pattern 

forward diagonal close 
or 

backward diagonal close 
44 . Draw the parse tree for the expression 
x X y + y + x 

based on the syntax diagrams in Figure 6.16. 

4 5 . What code optimization could be performed 
by a code generator when building the 
machine code representing the statement 

if (X = 5) then (Z <- X + 2) 
else (Z <- X + 4} 

4 6 . Simplify the following program segment 

Y <r- 5; 
if (Y = 7) 

then (Z e- 8) 

else (Z « - 9 ) 

4 7 . Simplify the following program segment 

while (X not equal to 5) do 
(X <- 5) 

*48. In an object-oriented programming environ- 
ment, how are types and classes similar? How 
are they different? 

*49. Describe how inheritance might be used to 
develop classes describing various types of 
buildings. 

*50. What is the difference between the public and 
private parts of a class? 

*51. a. Give an example of a situation in which an 
instance variable should be private. 

b. Give an example of a situation in which an 
instance variable should be public. 

c. Give an example of a situation in which a 
method should be private. 

d. Give an example of a situation in which a 
method should be public. 

*52. Describe some objects that might be found in a 
program for simulating the pedestrian traffic in a 
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hotel lobby. Include explanations of the actions 
some of the objects should be able to perform. 

•53. Draw a diagram (similar to Figure 6.25) repre- 
senting the resolutions needed to show that 
the collection of statements (QOR - R), (T 
OR R), - P , ( P O R -fT), and ( P O R - Q ) are 
inconsistent. 

*54. Is the collection of statements-R, (TORR), 
(P OR - Q), (Q OR - T), and (R OR -> P) consis- 
tent? Explain your answer. 

*55. What conclusions can Prolog find if faced with 
the goal 

bigger(X, lassie) . 

and the initial statements 

bigger(rex, lassie), 
biggerffido, rex) . 
bigger(spot, rex) . 

bigger(X,Z) bigger(X,Y), bigger 

(Y,Z) . 


*56. What conclusions can Prolog find if faced with 
the goal 
eq{x, Y} . 

and the initial statements 

grteq(a.b). 
grteq(b.c) . 
g rteq (c , a) . 

grteq(U,W) grteq(U,V), 
grteq(V.W). 

eq(X,Y) grteq(X.Y), grteq(Y.X). 

*57. What problem would be encountered if the fol- 
lowing program segment was executed on a 
computer in which values are represented in 
the eight-bit floating-point format described in 
Section 1.7? 

X <— 0 . 0 1 ; 

while (X not equal to i .00) do 
(print the value of X; 

X x + 0 . 01 ) 
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The following questions are intended as a guide to the ethical/social/legal issues asso- 
ciated with the field of computing. The goal is not merely to answer these questions. 
You should also consider why you answered as you did and whether your justifications 
are consistent from one question to the next. 

1. In general, copyright laws support ownership rights associated with the 
expression of an idea but not for the idea itself. As a result, a paragraph in a 
book is copyrightable but the ideas expressed in the paragraph are not. How 
should this right extend to source programs and the algorithms they express? 
To what extent should a person who knows the algorithms used in a commer- 
cial software package be allowed to write his or her own program expressing 
those same algorithms and market this version of the software? 

2. By using a high-level programming language a programmer is able to express 
algorithms using words such as if, then, and while. To what extent does the 
computer understand the meaning of those words? Does the ability to 
respond correctly to the use of words imply an understanding of the words? 
How do you know when another person has understood what you said? 

3. Should a person who develops a new and useful programming language have 
a right to profit from the use of that language? If so, how can that right be 
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protected? To what extent can a language be owned? To what extent should a 
company have the right to own the creative, intellectual accomplishments of 
its employees? 

4. To what extent is a programmer who helps develop a violent computer game 
responsible for any consequences of that game? Should children's access to 
computer games be restricted? If so, how and by whom? What about other 
groups in society, such as convicted criminals? 

5. With a deadline approaching, is it acceptable for a programmer to forgo docu- 
mentation via comment statements to get a program running on time? 
(Beginning students are often surprised to learn how important documenta- 
tion is considered among professional software developers.) 

6 . Much of the research in programming languages has been to develop lan- 
guages that allow programmers to write programs that can be easily read and 
understood by humans. To what extent should a programmer be required to 
use such capabilities? That is, to what extent is it good enough for the pro- 
gram to perform correctly even though it is not well written from a human 
perspective? 

7 Suppose an amateur programmer writes a program for his or her own use and 
in doing so is sloppy in the program's construction. The program does not use 
the programming language features that would make it more readable, it is 
not efficient, and it contains shortcuts that take advantage of the particular 
situation in which the programmer intends to use the program. Over time the 
programmer gives copies of the program to friends who want to use it them- 
selves, and these friends give it to their friends. To what extent is the pro- 
grammer liable for problems that might occur? 

8 To what extent should a computer professional be knowledgeable in the vari- 
ous programming paradigms? Some companies insist that all software devel- 
oped in that company be written in the same, predetermined programming 
language. Does your answer to the original question change if the profes- 
sional works for such a company? 
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Software engineering is the branch of computer science that seeks principles to guide 
the development of large, complex software systems. The problems faced in devel- 
oping such systems are more than enlarged versions of those problems faced in writ- 
ing small programs. For instance, the development of large systems requires the efforts 
of more than one person over an extended period of time during which the require- 
ments of the proposed system might be altered and the personnel assigned to the 
project might change. Consequently, software engineering includes topics such as 
personnel and project management that are more readily associated with business 
management than computer science. We, however, will focus on topics readily related 
to computer science. 


7.1 The Software Engineering Discipline 

To appreciate the problems involved in software engineering, it is helpful to select a 
large, complex device (an automobile, a multistory office building, or perhaps a cathe- 
dral) and imagine being asked to design it and then to supervise its construction. How 
can you estimate the cost in time, money, and other resources to complete the proj- 
ect? How can you divide the project into manageable pieces? How can you ensure that 
the pieces produced are compatible? How can those working on the various pieces 
communicate? How can you measure progress? How can you cope with the wide 
range of detail (the selection of the doorknobs, the design of the gargoyles, the avail- 
ability ofblue glass for the stained glass windows, the strength of the pillars, the design 
of the duct work for the heating system)? Questions of the same scope must be 
answered during the development of a large software system. 

Because engineering is a well-established field, you might think that there is a wealth 
of previously developed engineering techniques that can be useful in answering such 
questions. This reasoning is partially true, but it overlooks fundamental differences 
between the properties of software and those of other fields of engineering. These dis- 
tinctions have challenged software engineering projects, leading to cost overruns, late 
delivery of products, and dissatisfied customers. In turn, identifying these distinctions 
has proven to be the first step in advancing the software engineering discipline. 

One such distinction deals with the ability to construct systems from generic pre- 
fabricated components. Traditional fields of engineering have long benefited from 
the ability to use "off-the-shelf components as building blocks for constructing com- 
plex devices. The designer of a new automobile does not have to design a new engine 
or transmission but instead uses previously designed versions of these components. 
In the context of software engineering, however, previously designed components 
tend to be domain specific-that is, their internal design is based on a specific appli- 
cation-and thus their use as generic components is limited. The result is that com- 
plex software systems have historically been built from scratch. Although the search 
for ways of developing generic software components has been difficult, significant 
progress is now being made, as we will see in this chapter. 

Another distinction between software engineering and other engineering disci- 
plines is the lack of quantitative techniques, called metrics, for measuring the properties 
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Association for Computing Machinery 

The Association for Computing Machinery (ACM) was founded in 1947 as an 
international scientific and educational organization dedicated to advancing the 
arts, sciences, and applications of information technology. It is headquartered in 
New York and includes numerous special interest groups (SIGsj focusing on 
such topics as computer architecture, artificial intelligence, biomedical computing, 
computers and society, computer science education, computer graphics, hyper- 
text/hypermedia, operating systems, programming languages, simulation and 
modeling, and software engineering. The ACM's website is at http : / /www. 
acm. org. Its Code of Ethics and Professional Conduct can be found at http: / / 
www.acm.org/constitution/code.html 


of software. For example, to project the cost of developing a software system, one would 
like to estimate the complexity of the proposed product, but methods for measuring the 
"complexity" of software are evasive. Similarly, evaluating the quality of a software 
product is challenging. The quality of a mechanical device is often measured in terms 
of the mean time between failures, which is essentially a measurement of how well the 
device endures wear. Software, in contrast, does not wear out, so this method of meas- 
uring quality is not as applicable in software engineering. 

The difficulties involved in measuring software properties in a quantitative man- 
ner constitute one of the reasons that software engineering has struggled to find a 
rigorous footing in the same sense as mechanical and electrical engineering. Whereas 
these latter subjects are founded on the established science of physics, software engi- 
neering continues to search for its roots. In a sense, the state of software engineering 
today is similar to that of mechanical engineering in the early seventeenth century 
before Isaac Newton and others discovered that properties such as mass, accelera- 
tion, and force could be measured and related to each other mathematically. 

Thus research in software engineering is currently progressing on two levels: 
Some researchers, sometimes called practitioners, work toward developing techniques 
for immediate application, while others, called theoreticians, search for underlying 
principles and theories on which more stable techniques can someday be constructed. 
Being based on a subjective foundation, many methodologies developed and pro- 
moted by practitioners in the past have been replaced by other approaches that might 
themselves become obsolete with time. Meanwhile, progress by theoreticians con- 
tinues to be slow. 

The need for progress by both practitioners and theoreticians is enormous. Our 
society has become addicted to computer systems and their associated software. Our 
economy, health care, government, law enforcement, transportation, and defense 
depend on large software systems. Yet there continue to be major problems with the 
reliability of these systems. Software errors have caused such disasters and near dis- 
asters as the rising moon being interpreted as a nuclear attack, a one-day loss of $5 
million by the Bank of New York, the loss of space probes, radiation overdoses that 
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Institute of Electrical and Electronics Engineers 

The Institute of Electrical and Electronics Engineers (IEEE, pronounced "i-triple-e") 
is an organization of electrical, electronics, and manufacturing engineers that was 
formed in 1963 as a result of merging the American Institute of Electrical Engi- 
neers (founded in 1884 by 25 electrical engineers, including Thomas Edison) and 
the Institute of Radio Engineers (founded in 1912). Today, IEEE's operation cen- 
ter is located in Piscataway, New Jersey. The Institute includes numerous techni- 
cal societies such as the Aerospace and Electronic Systems Society, the Lasers 
and Electro-Optics Society, the Robotics and Automation Society, the Vehicular 
Technology Society, and (most important for our study) the Computer Society. 
Among its activities, IEEE is involved in the development of standards. In partic- 
ular, IEEE's efforts led to the standards used in most computers today for repre- 
senting values in floating-point format. 

You will find the IEEE's Web page at http : // w w w . ieee.org , the IEEE 
Computer Society's Web page at http :// www.computer.org , and the IEEE's 
Code of Ethics at http://www.ieee.org/about/whatis/code.html 


have killed and paralyzed, and the simultaneous disruption of telephone communi- 
cations over large regions. 

This is not to say that the situation is all bleak. Much progress is being made in 
overcoming such problems as the lack of prefabricated components and metrics. 
Moreover, the application of computer technology to the software development 
process, resulting in what is called computer-aided software engineering (CASE), 
is continuing to streamline and otherwise simplify the software development process. 
CASE has lead to the development of a variety of computerized systems, known as 
CASE tools, which include project planning systems (to assist in cost estimation, 
project scheduling, and personnel allocation), project management systems (to assist 
in monitoring the progress of the development project), documentation tools (to assist 
in writing and organizing documentation), prototyping and simulation systems (to 
assist in the development of prototypes), interface design systems (to assist in the 
development of GUIs), and programming systems (to .!ssis L in writing and debugging 
programs). Some of these tools are little more than the word processors, spreadsheet 
software, and email communication systems that were originally development for 
generic use and adopted by software engineers. Others are quite sophisticated pack- 
ages designed primarily for the software engineering environment. For example, some 
CASE tools include code generators that, when given specifications for a part of a sys- 
tem, produce high-level language programs that implement that part of the system. 

While researchers continue to search for methods of developing better-quality soft- 
ware, professional organizations have contributed their efforts indirectly by promoting 
high standards of ethics and professional conduct among their membership. For exam- 
ple, the Association of Computing Machinery (ACM) and the Institute of Electrical and 
Electronics Engineers (IEEE) have adopted codes of professional conduct and ethics 
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that enhance the professionalism of software developers and counter nonchalant atti- 
tudes toward each individual's responsibilities. 

In the remainder of this chapter we discuss some of the fundamental principles 
of software engineering {such as the software life cycle and modularity), look at some 
of the directions in which software engineering is moving (such as the identification 
and application of design patterns and the emergence of reusable software compo- 
nents), and witness the effects that the object-oriented paradigm has had on the field. 


1. Why would the number of lines in a program not be a good measure of the 

complexity of the program? & 

2. Suggest a metric for measuring software quality. What weaknesses does your 
metric have? 

3. What technique can be used to determine how many errors are in a unit of 
software? 

4. Identify another field that, like software engineering, is still struggling to find 
its scientific foundation and thus continues to apply techniques developed 
largely by practitioners rather than theoreticians. 


7.2 The Software Life Cycle 

The most fundamental concept in software engineering is the software life cycle. 


The Cycle as a Whole 

The software life cycle is shown in Figure 7.1. This figure represents the fact that 
once software is developed, it enters a cycle of being used and modified that contin- 
ues for the rest of the software’s life. Such a pattern is common for many manufac- 
tured products as well. The difference is that, in the case of other products, the 
modification phase is more accurately called a repair or maintenance phase because 
their parts tend to deteriorate. 


F i g u re 7.1 The software life cycle 
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Software, on the other hand, does not deteriorate. Instead, software moves into 
the modification phase because errors are discovered, because changes in the soft- 
ware's application occur that require corresponding changes in the software, or 
because changes made during a previous modification are found to induce problems 
elsewhere in the software. 

Regardless of why software enters the modification phase, the process requires 
that a person (often not the original author) study the underlying program and its 
documentation until the program, or at least the pertinent part of the program, is 
understood. Otherwise, any modification could introduce more problems than it 
solves. Acquiring this understanding can be a difficult task, even when the software 
is well-designed and documented. In fact, it is often within this phase that a piece of 
software is discarded under the pretense (too often true) that it was easier to develop 
a new system from scratch than to modify the existing package successfully. 

Experience has shown that a little effort during the development of software can 
make a tremendous difference when modifications in the software are required. For 
example, in our discussion of data description statements in Chapter 6 we saw how 
the use of constants rather than literals can greatly simplify future adjustments. In 
turn, most of the research in software engineering focuses on the development stage 
of the software life cycle, with the goal being to take advantage of this effort- versus- 
benefit leverage. 

The Traditional Development Phase 

The major stages within the development phase of the software life cycle are analy- 
sis, design, implementation, and testing (Figure 7.2). 

Analysis The development phase of the software life cycle begins with analysis- 
a major goal being to specify what services the proposed system is to provide and to 
identify any conditions (time constraints, security, etc.) on those services. Analysis 
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involves significant input from the future user of the proposed system. In fact, analy- 
sis might start with a feasibility study conducted solely by the user. This is often true 
in the traditional software development context in which the user is an entity, such 
as a company or government agency, that contracts with a software developer. In 
other cases, a software developer might produce software (sometimes called shrink- 
wrapped software) for the mass market, perhaps to be sold in retail stores or down- 
loaded via the Internet. In this setting the user is a less precisely defined entity, and 
analysis might begin with a market study by the software developer. 

As the needs of the potential user are identified, they are compiled to form a set 
of requirements that the new system must satisfy. These requirements are stated in 
terms of the application rather than in the technical terminology of the engineering 
community. One requirement might be that access to data must be restricted to author- 
ized personnel. Another might be that the data must reflect the current state of the 
inventory as of the end of the last business day. Still another might be that the arrange- 
ment of the data as displayed on the computer screen must adhere to the format of 
the paper forms currently in use. 

After the system requirements are identified, they are converted into more tech- 
nical specifications. For example, the requirement that data be restricted to author- 
ized personnel might become the specification that the system will not respond until 
an approved eight-digit password has been typed at the keyboard or that data will be 
displayed in encrypted form unless preprocessed by a routine known only to author- 
ized personnel. 

Ideally, the analysis stage of software development concludes with a document, 
often called a software requirements document, that identifies the requirements 
and specifications of the proposed system. The significance of this document is 
shown by the fact that professional organizations such as IEEE and large software 
clients such as the U.S. Department of Defense have adopted standards for its com- 
position. In a sense, the software requirements document is a written agreement 
between all parties concerned, which is intended to guide the software's develop- 
ment and provide a means of resolving disputes that might arise later in the devel- 
opment process. 

From the software developer's perspective, the software requirements document 
should define a firm objective toward which the software's development can proceed. 
Too often, however, the document fails to provide this stability. Indeed, most practi- 
tioners in the software engineering field argue that poor communication and chang- 
ing requirements are the major causes of cost overruns and late product delivery in 
the software engineering industry. Few customers would insist on major changes to 
a building's floor plan once the foundation has been constructed, but instances abound 
of organizations that have expanded, or otherwise altered, the desired capabilities of 
a software system well after the software's construction was underway. This might 
have been because a company decided that the system being developed for only a sub- 
sidiary should instead apply to the entire corporation or that advances in technology 
supplanted the capabilities available during the initial analysis. In any case, software 
engineers have found that straightforward and frequent communication with the cus- 
tomer is mandatory. 
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Design Whereas analysis concentrates on what the proposed system Should do, 
design concentrates on how the system will accomplish those goals. It is here that 
the structure of the software system is established. 

If the project were to construct a shopping center rather than a software system, 
this would be the stage at which an architect, having established the project's require- 
ments, would develop detailed plans for the site. The result would include a collec- 
tion of blueprints describing the proposed center at various levels of detaO and perhaps 
a three-dimensional scale model of the proposed structures. Likewise, diagramming 
and modeling play important roles in the design of software. However, the method- 
ologies and notational systems used by software engineers are not as stable as they 
are in the architectural field. Indeed, when compared to the well-established discipline 
of architecture, the practice of software engineering appears very dynamic as 
researchers struggle to find better approaches to the software development process. 
We will explore this shifting terrain in Section 7.5. 

We should also note that when an architect designs a shopping center, not all of 
the architect's attention is devoted to the structural integrity of buildings-a signifi- 
cant amount of attention is given to the manner in which customers will interact with 
the center. In particular, the architect must consider convenience of access, visual 
appeal, and the general ambiance of the center's environment. In a similar manner, 
an important part of a software system's design involves the system's interface with 
its users. In fact, designing the user interface has become a subject of its own- a sub- 
ject that draws heavily from such diverse fields as psychology and ergonomics. 

Implementation Implementation involves the actual writing of programs, creation 
of data files, and development of databases. From a traditional point of view, imple- 
mentation is seen as a bottom-up process in which individual modules are pro- 
grammed and then combined to form larger components of the system. This does 
not mean, however, that each module is always implemented in its entirety before 
being combined with others. At times partial modules are constructed, used in larger 
components, and then expanded into complete, fully functional components later in 
the implementation process. Furthermore, as we will see in the next section, this bot- 
tom-up approach to implementation is often replaced today by a top-down approach 
in which a skeletal version of the entire system is implemented first and later filled 
in to provide a complete system. 

It is at the implementation stage that we see the distinction between the tasks of 
a software analyst (sometimes referred to as a system analyst) and a programmer. 
The former is a person involved with the entire development process, perhaps with 
an emphasis on the analysis and design steps. The latter is a person involved prima- 
rily with the implementation step. In its narrowest interpretation, a programmer is 
charged with writing programs that implement the design produced by a software 
analyst. Having made this distinction, we should note again that there is no central 
authority controlling the use of terminology throughout the computing community. 
Many who carry the title of software analyst are essentially programmers, and many 
with the title programmer (or perhaps senior programmer) are actually software ana- 
lysts in the full sense of the term. This blurring of terminology is founded in the fact 
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that today the steps in the software development process are often intermingled, as 
we will soon see. 

Testing Testing occurs in two forms. One, called validation testing, involves con- 
firming that the software system as implemented conforms to the requirements and 
specifications identified during the original analysis. The other, called defect testing, 
involves identifying and correcting errors. Validation testing might confirm that the 
system does, in fact, produce a properly formatted summary of a bank customer's 
account, whereas defect testing might reveal that the account balance appearing in 
that report is incorrect. Both forms of testing are closely associated with implemen- 
tation, because each module of a complex system is normally tested as it is imple- 
mented. Indeed, each module in a well-designed system can be tested independently 
of the others by using simplified versions of the other modules to simulate the inter- 
action between the target module and the rest of the system. Of course, this testing 
of modules gives way to overall system testing as the various modules are completed 
and combined. 

Unfortunately, the testing of a system, especially defect testing, is extremely dif- 
ficult to perform successfully. Experience has shown that large software systems can 
contain numerous errors, even after significant testing. Many of these errors might 
go undetected for the life of the system, but others might cause major malfunctions. 
The elimination of such errors is one of the goals of software engineering. The fact 
that they are still prevalent means that a lot of research remains to be done. 


1. What is the difference between system requirements and system specifications? 

2. Summarize each of the four stages (analysis, design, implementation, and 
testing) within the development phase of the software life cycle. 

3. What is the role of a software requirements document? 


7.3 Software Engineering Methodologies 

Early approaches to software engineering insisted on performing analysis, design, 
implementation, and testing in a strictly sequential manner. The belief was that too 
much was at risk during the development of a large software system to allow for vari- 
ations. As a result, software engineers insisted that the entire analysis of the system 
be completed before beginning the design and, likewise, that the design be completed 
before beginning implementation. The result was a development process now referred 
to as the waterfall model, an analogy to the fact that the development process was 
allowed to flow in only one direction. 

In recent years, software engineering techniques have changed to reflect the con- 
tradiction between the highly structured environment dictated by the waterfall model 
and the "free-wheeling," trial-and-error process that is often vital to creative problem 
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solving. This is illustrated by the emergence of the incremental model for software 
development. Following this model, the desired software system is constructed in 
increments-the first being a simplified version of the final product with limited func- 
tionality. Once this version has been tested and perhaps evaluated by the future user, 
more features are added and tested in an incremental manner until the system is 
complete. For example, if the system being developed is a patient records system for 
a hospital, the first increment might incorporate only the ability to view patient records 
from a small sample of the entire record system. Once that version is operational, 
additional features, such as the ability to add and update records, would be added in 
a stepwise manner. 

The incremental model is evidence of the trend in software development toward 
prototyping in which incomplete versions of the proposed system, called proto- 
types, are built and evaluated. In the case of the incremental model these prototypes 
evolve into the complete, final system-a process known as evolutionary proto- 
typing. In other cases, the prototypes might be discarded in favor of a fresh imple- 
mentation of the final design. This approach is known as throwaway prototyping. 
An example that normally falls within this throwaway category is rapid prototyping 
in which a simple example of the proposed system is quickly constructed in the early 
stages of development. Such a prototype might consist of only a few screen images 
that give an indication of how the system will interact with the user and what capa- 
bilities it will have. The goal is not to produce a working version of the product but to 
obtain a demonstration tool that can be used to clarify communication between the 
parties involved in the software development process. For example, rapid prototypes 
have proved advantageous in clarifying system requirements during the analysis stage 
or as aids during sales presentations to potential clients. 

A variation of evolutionary prototyping that has been used for years by computer 
enthusiasts/hobbyists is known as open-source development. (This is the means by 
which much of today's free software is produced. Perhaps the most prominent exam- 
ple is the Linux operating system, whose open-source development was originally 
led by Linus Torvald.) The open-source development of a software package proceeds 
as follows: A single author writes an initial version of the software (usually to fulfill 
his or her own needs) and posts the source code and its documentation on the Inter- 
net. From there it can be downloaded and used by others without charge. Since these 
other users have the source code and documentation, they are able to modify or 
enhance the software to fit their own needs or to correct errors that they find. They 
report these changes to the original author, who incorporates them into the posted ver- 
sion of the software, making this extended version available for further modifications. 
In practice, it is possible for a software package to evolve through several extensions 
in a single week. 

Perhaps the most pronounced shift from the waterfall model is the methodology 
called extreme programming ( X P ) . Following the XP model, software is developed 
by a team of less than a dozen individuals working in a communal work space where 
they freely share ideas and assist each other in the development project. The software 
is developed incrementally by means of repeated daily cycles of analyzing, designing, 
implementing, and testing. Thus, new expanded versions of the software package 


appear on a regular basis, each of which can be evaluated by clients and used to point 
toward further increments. In summary, extreme programming is characterized by 
flexibility, which is in stark contrast to the waterfall model that conjures the image of 
managers and programmers working in individual offices while rigidly performing 
well-defined portions of the overall software development task. 

The contrasts depicted by comparing the waterfall model and XP reveal the 
breadth of methodologies that are being applied to the software development process 
in the hope of finding better ways to construct reliable software in an efficient man- 
ner. Research in the field is an ongoing process. Progress is being made, but much work 
remains to be done. 


1. Summarize the distinction between the traditional waterfall model of software 
development and the newer prototyping paradigm. 

2. What is the distinction between traditional evolutionary prototyping and 
open-source development? 

3. What potential problems do you suspect could arise in terms of ownership 
rights of software developed via the open-source methodology? 


7.4 Modularity 

A key point in Section 7.2 is that to modify software one must understand the program 
or at least the pertinent parts of the program. Gaining such an understanding is often 
difficult enough in the case of small programs and would be close to impossible when 
dealing with large software systems if it were not for modularity-that is, the divi- 
sion of software into manageable units, generically called modules, each of which 
deals with only a part of the software's overall responsibility (and serves as an abstract 
tool for the other modules in the system). 

Modular Implementation 

Software modules come in a variety of forms. We have already seen (Chapters 5 and 
6), that in the context of the imperative paradigm, modules appear as procedures. In 
contrast, the object-oriented paradigm utilizes objects as the basic modular con- 
stituents. These distinctions are important since they determine the underlying goal 
during the initial software design process. Is the goal to represent the overall task as 
individual, manageable procedures or to identify the objects in the system and under- 
stand how they interact? 

To illustrate, let us consider how the process of developing a simple modular pro- 
gram to simulate a tennis game might progress in the imperative and the object-ori- 
ented paradigms. In the imperative paradigm we begin by considering the actions that 
must take place. Since each volley begins with a player serving the ball, we might start 
by considering a procedure named Serve that (based on the player's characteristics 
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Software Engineering in the Real World 

The following scenario is typical of the problems encountered by real-world soft- 
ware engineers. Company XYZ hires a software-engineering firm to develop and 
install a company-wide integrated software system to handle the company's data 
processing needs. As a part of the system produced by Company XYZ, a network 
of PCs is used to provide employees access to the company-wide system. Thus 
each employee finds a PC on his or her desk. Soon these PCs are used not only 
to access the new data management system but also as customizable tools with 
which each employee increases his or her productivity. For example, one 
employee may develop a spreadsheet program that streamlines that employee's 
tasks. Unfortunately, such customized applications may not be well designed or 
thoroughly tested and may involve features that are not completely understood 
by the employee. As the years go by, the use of these ad hoc applications 
becomes integrated into the company's internal business procedures. Moreover, 
the employees who developed these applications may be promoted or trans- 
ferred, or quit the company, leaving others behind using a program they do not 
understand. The result is that what started out as a well-designed, coherent sys- 
tem can become dependent on a patchwork of poorly designed, undocumented, 
and error-prone applications. 


and perhaps a bit of probability) would compute the initial speed and direction of the 
ball. Next we would need to determine the path of the ball (Will it hit the net? Where 
will it bounce?). We might plan on placing these computations in another procedure 
named ComputePath. The next step might be to determine if the other player is able 
to return the ball, and if so we must compute the ball's new speed and direction. We 
might plan on placing these computations in a procedure named Return. 

Continuing in this fashion, we might arrive at the modular structure depicted by 
the structure chart shown in Figure 7.3, in which procedures are represented by 
rectangles and procedure dependencies (implemented by procedure calls) are rep- 
resented by arrows. In particular, the chart indicates that the entire game is overseen 


Figure 7.3 A simple structure chart 


ControlGame 



Serve 


Return 


ComputePath 


UpdateScore 



7.4 Modularity 339j 


by a procedure named ControlGame, and to perform its task, ControlGame calls on 
the services of the procedures Serve, Return, ComputePath, and UpdateScore. 

Note that the structure chart does not indicate how each procedure is to perform its 
task. Rather, it merely identifies the procedures and indicates the dependencies among 
the procedures. In reality, the procedure ControlGame might perform its task by first 
calling the Serve procedure, then repeatedly calling on the procedures ComputePath 
and Return until one reports a miss, and finally calling on the services of UpdateScore 
before repeating the whole process by again calling on Serve. 

At this stage we have obtained only a very simplistic outline of the desired pro- 
gram, but our point has already been made. In accordance with the imperative para- 
digm, we have been designing the program by considering the activities that must be 
performed and are therefore obtaining a design in which the modules are procedures. 

Let us now reconsider the program's design-this time in the context of the object- 
oriented paradigm. Our first thought might be that there are two players that we 
should represent by two objects: Player A and PlayerB. These objects will have the 
same functionality but different characteristics. (Both should be able to serve and 
return volleys but might do so with different skill and strength.) Thus, these objects 
will be instances of the same class. This class, which we will call Play erClas s , will 
contain the methods, serve and return, that simulate the corresponding actions of 
the player. It will also contain internal attributes (such as Skill and Endurance) 
whose values reflect the player's characteristics. (For those who read the optional Sec- 
tion 6.5, we should point out that these attributes would probably be initialized by a 
constructor when the player objects are created.) Our design so far is represented by 
the diagram in Figure 7.4. There we see that Player A and PlayerB are instances of 
the class PlayerClass and that this class contains the attributes Skill and 
Endurance as well as the methods serve and return. 

Next we need an object to play the role of the official who determines whether the 
actions performed by the players are legal. For example, did the serve clear the net and 
land in the appropriate area of the court? For this purpose we might establish an object 
called Judge that contains the methods evaluateServe and evaluateReturn. If 

Figure 7.4 The structure of PlayerClass and Its instance? 
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the Judge object determines a serve or return to be acceptable, play continues. Oth- 
erwise, the Judge sends a message to another object named Score to record the 
results accordingly. 

At this point the design for our tennis program consists of four objects: Play er A, 
PlayerB, Judge, and Score. Atypical interaction between these objects is depicted 
by the collaboration diagram in Figure 7.5. The sequence of action (the volley) 
begins by activating the serve method in PlayerA. The results are sent to the object 
Judge where they are evaluated by the evaluates erve method, judged to be legal, 
and passed on to PlayerB. PlayerB 's response is determined by its return method. 
The results are sent back to Judge, where they are found to be illegal (perhaps the 
return did not get over the net). Thus, the object Judge sends an UpdateScore mes- 
sage to Score, and the sequence (the volley) terminates. 

As in the case of our imperative example, our object-oriented program is very sim- 
plistic at this stage. However, we have progressed enough to see how the object-oriented 
paradigm leads to a modular design in which fundamental components are objects. 

Coupling 

We have introduced modularity as a way of producing manageable software. The idea 
is that any future modification will likely apply to only a few of the modules, allowing 
the person making the modification to concentrate on that portion of the system rather 
than struggling with the entire package. This, of course, depends on the assumption 
that changes in one module will not unknowingly affect other modules in the system. 
Consequently, a goal when designing a modular system should be to maximize inde- 
pendence among modules or, in other words, to minimize the linkage between mod- 
ules (known as intermodule coupling). Indeed, one metric that has been used to 
measure the complexity of a software system (and thus obtain a means of estimating 
the expense of maintaining the software) is to measure its intermodule coupling. 


Figure 7.5 A simple collaboration diagram 
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Intermodule coupling occurs in several forms. One is control coupling, which 
occurs when a module passes control of execution to another, as in a procedure call. 
The structure chart in Figure 7.3 represents the control coupling that exists between 
procedures. In particular, the arrow from the module ControlGame to Serve indi- 
cates that the former passes control to the latter. It is also control coupling that is rep- 
resented in the collaboration diagram in Figure 7.5, where the arrows trace the path 
of control as it is passed from object to object. 

Another form of intermodule coupling is data coupling, which refers to the shar- 
ing of data between modules. If two modules interact with the same item of data, 
then modifications made to one module might affect the other, and modifications to 
the format of the data itself could have repercussions in both modules. 

Data coupling between procedures can occur in two forms. One is by explicitly 
passing data from one procedure to another in the form of parameters. Such coupling 
is represented in a structure chart by an arrow between the procedures that is labeled 
to indicate the data being passed. The direction of the arrow indicates the direction 
in which the item is transferred. For example. Figure 7.6 is an extended version of Fig- 
ure 7.3 in which we have indicated that the procedure ControlGame will tell the 
procedure Serve which player's characteristics are to be simulated when it calls 
Serve and that the procedure Serve will report the ball trajectory to ControlGame 
when Serve has completed its task. 

Similar data coupling occurs between objects in an object-oriented design. For 
example, when PlayerA asks the object Judge to evaluate its serve (see Figure 7.5), 
it must pass the trajectory information to Judge. On the other hand, one of the ben- 
efits of the object-oriented paradigm is that it inherently tends to reduce data coupling 
between objects to a minimum. This is because the methods within an object tend to 
include all those procedures that manipulate the object's internal data. For example, 
the object PlayerA will contain information regarding that player's characteristics as 
well as all the methods that require that information. In turn, there is no need to pass 
that information to other objects and thus inter-object data coupling is minimized. 

In contrast to passing data explicitly as parameters, data can be shared among 
modules implicitly in the form of global data, which are data items that are auto- 
matically available to all modules throughout the system, as opposed to local data 
items that are accessible only within a particular module unless explicitly passed to 


Figure 7.6 A structure chart including data coupling 
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another. Most high-level languages provide ways of implementing both global and 
local data, but the use of global data should be employed with caution. The problem 
is that a person trying to modify a module that is dependent on global data might find 
it difficult to identify how the module in question interacts with other modules. In 
short, the use of global data can degrade the module's usefulness as an abstract tool. 


Cohesion 

Just as important as minimizing the coupling between modules is maximizing the 
internal binding within each module. The term cohesion refers to this internal bind- 
ing or, in other words, the degree of relatedness of a module's internal parts, lb appre- 
ciate the importance of cohesion, we must look beyond the initial development of a 
system and consider the entire software life cycle. If it becomes necessary to make 
changes in a module, the existence of a variety of activities within it can confuse what 
would otherwise be a simple process. Thus, in addition to seeking low intermodule 
coupling, software designers strive for high intramodule cohesion. 

A weak form of cohesion is known as logical cohesion. This is the cohesion 
within a module induced by the fact that its internal elements perform activities log- 
ically similar in nature. For example, consider a module that performs all of a system's 
communication with the outside world. The "glue" that holds such a module together 
is that all the activities within the module deal with communication. However, the top- 
ics of the communication can vary greatly. Some might deal with obtaining data, 
while others deal with reporting results. 

A stronger form of cohesion is known as functional cohesion, which means 
that all the parts of the module are focused on the performance of a single activity. 
In an imperative design, functional cohesion can often be increased by isolating sub- 
tasks in other modules and then using these modules as abstract tools. This is demon- 
strated in our tennis simulation example (see again Figure 7.3) where the module 
ControlGame uses the other modules as abstract tools so that it can concentrate on 
overseeing the game rather than being distracted by the details of serving, returning, 
and maintaining the score. 

In object-oriented designs, entire objects are usually only logically cohesive since 
the methods within an object often perform loosely related activities-the only com- 
mon bond being that they are activities performed by the same object. For example, 
in our tennis simulation example, each player object contains methods for serving as 
well as returning the ball, which are significantly different activities. Such an object 
would therefore be only a logically cohesive module. However, software designers 
should strive to make each individual method within an object functionally cohesive. 
That is, even though the object in its entirety is only logically cohesive, each method 
within an object should perform only one functionally cohesive task (Figure 7.7). 

Components 

We have already mentioned that one obstacle in the field of software engineering is 
the lack of prefabricated "off-the-shelf components from which large software systems 
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Figure 7.7 Logical and functional cohesion within an object 
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can be constructed. The modular approach to software development offers hope in this 
regard. In particular, the object-oriented programming paradigm is proving especially 
useful because objects form complete, self-contained units that have clearly defined 
interfaces with their environments. Once an object has been designed to fulfill a cer- 
tain role, it can be used to fulfill that role in any program requiring that service. More- 
over, inheritance (Section 6.5) provides a means of refining prefabricated object 
definitions in those cases in which the definitions must be customized to conform to 
the needs of a specific application. 

It is not surprising, then, that the object-oriented programming languages C+ + , 
Java, and C# are accompanied by collections of prefabricated "templates" from which 
programmers can easily implement objects for performing certain roles. In particu- 
lar, C + + is associated with the C + + Standard Template Library; the Java programming 
environment is accompanied by the Java Application Programmer Interface (API); and 
C# programmers have access to the .NET Framework Class Library. 

Although objects have the potential of providing prefabricated building blocks for 
software design, they are not perfect. One problem is that they provide relatively small 
blocks from which to build. Thus, an object is actually a special case of the more gen- 
eral concept of a component, which is, by definition, a reusable unit of software. In prac- 
tice, most components are based on the object-oriented paradigm where each component 
takes the form of a collection of one or more objects that function as a self-contained unit. 

Research in the development and use of components has led to the emerging field 
known as component architecture in which the traditional role of a programmer is 
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replaced by a component assembler who constructs software systems from prefab- 
ricated components that, in many development environments, are displayed as icons 
in a graphical interface. Rather than be involved with the internal programming of the 
components, the methodology of a component assembler is to select pertinent com- 
ponents from collections of predefined components and then connect them, with min- 
imal customization, to obtain the desired functionality. Indeed, a property of a 
well-designed component is that it can be extended to encompass features of a par- 
ticular application without internal modifications. 

Both Sun Microsystems and Microsoft provide tools with which component assem- 
blers can construct software. In Sun's product, components are called Java Beans, in 
keeping with the Java theme from which the Java programming language was named. 
Microsoft's approach is packaged in the software development environment known 
as .NET (pronounced "dot-NET"). 


Questions 
& Exercises 


1. How does a novel differ from an encyclopedia in terms of the degree of cou- 
pling between its units such as chapters, sections, or entries? What about 
cohesion? 

2. A sporting event is often divided into units. For example, a baseball game is 
divided into innings and a tennis match is divided into sets. Analyze the 
coupling between such "modules." In what sense are such units cohesive? 

3. Is the goal of maximizing cohesion compatible with minimizing coupling? 
That is, as cohesion increases, does coupling naturally tend to decrease? 

4 . Extend the structure chart in Figure 7.3 to include the data coupling 
between the modules ControlGame and UpdateScore. 

5. Change the collaboration diagram in Figure 7.5 to represent the sequence 
that would occur if PlayerB successfully returns PlayerA's serve but 
PlayerA fails to make the return. 

6 . What is the difference between a traditional programmer and a component 
assembler? 


7.5 Tools of the Trade 

In this section we investigate some of the modeling techniques and notational systems 
used during the analysis and design stages of software development. Some of these 
were developed during the years that the imperative paradigm dominated the software 
engineering discipline. Of these, some have found useful roles in the context of the 
object-oriented paradigm while others, such as the structure chart (see again Figure 
7.3), are specific to the imperative paradigm. We begin by considering some of the tech- 
niques that have survived from their imperative roots and then move on to explore 
newer object-oriented tools as well as the expanding role of design patterns. 
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System Design Tragedies 

The need for good design disciplines is exemplified by the problems encountered 
in the Therac-25, which was a computer-based electron-accelerator radiation- 
therapy system used by the medical community in the middle 1980s. Flaws in 
the machine’s design contributed to six cases of radiation overdose-and three 
of these resulted in death. The flaws included (1) a poor design for the 
machine's interface that allowed the operator to begin radiation before the 
machine had adjusted for the proper dosage, and (2) poor coordination 
between the design of the hardware and the software, which resulted in the 
absence of certain safety features. 

In more recent cases, poor design has led to widespread power outages, 
severance of telephone service, major errors in financial transactions, loss of 
space probes, and disruption of the Internet. You can learn more about such 
problems through the Risks Forum (its Web page is at http://catless.ncl . 

ac.uk/Risks ) . 


Some Old Friends 

Although the imperative paradigm seeks to build software in terms of procedures, a 
way of identifying those procedures is to consider the data to be manipulated rather 
than the procedures themselves. The theory is that by studying how data moves 
through a system, one identifies the points at which either data formats are altered or 
data paths merge and split. In turn, these are the locations at which processing occurs, 
and thus dataflow analysis leads to the identification of procedures. A dataflow dia- 
gram is a means of representing the information gained from such dataflow studies. 
In a dataflow diagram, arrows represent data paths, ovals represent points at which 
data manipulation occurs, and rectangles represent data sources and stores. As an 
example. Figure 7.8 displays an elementary dataflow diagram representing a hospital's 
patient billing system. Note that the diagram shows that Payments (flowing from 


Figure 7.8 A simple dataflow diagram 
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patients) and Patient-Records (flowing from the hospital's files) merge at the oval 
ProcessPayments from which updatedRecords flow back to the hospital's files. 

Dataflow diagrams not only assist in identifying procedures during the design stage 
of software development They are also useful in trying to gain an understanding of 
the proposed system during the analysis Stage. Indeed, constructing dataflow diagrams 
can serve as a means of improving communication between clients and software engi- 
neers (as the software engineer struggles to understand what the client wants and the 
client struggles to describe his or her expectations), and thus these diagrams continue 
to find applications even though the imperative paradigm has faded in popularity. 

Another tool that is useful during both analysis and design is the entity- 
relationship diagram, which is a pictorial representation of the items of information 
(entities) within the system and the relationships between these pieces of informa- 
tion. As an example, let us consider the entity-relationship diagram in Figure 7.9 
representing physicians, patients, and hospital rooms. There we see that the entities 
Physician, Patient, and Room are represented as rectangles and the relationships 
between entities are represented by diamonds that are connected by arrows to the 
entities involved. In particular, the diagram indicates that physicians and patients are 
associated by the relationship called At tending Physician and patients and rooms 
are associated by the relationship RoomAssignment. 

There is, however, a different structure associated with the two relationships in 
our example. The relationship between physicians and patients is a one-to-many 
relationship in that each physician attends to several patients but each patient has 
only one attending (or primary) physician. In contrast, the relationship between 
patients and rooms is a one-to-one relationship because each patient is assigned to 
only one room and each room is assigned to only one patient. (We are assuming that 
each room is a private room.) These distinctions are indicated by the points of the 
arrows in the diagram. A single point indicates that only one occurrence of the entity 
is involved in the relationship; a double point indicates that more than one instance 
of the entity might be involved. Thus, if the rooms were not private rooms, the arrow 
pointing to the entity Patient in the RoomAssigment relationship would be have 
a double point instead of a single, indicating that more than one patient might be 
involved in an instance of a RoomAssignment. 

Still another type of relationship is the many-to-many relationship, which we 
would encounter if we considered the relationship between patients and consulting 
physicians instead of patients and primary physicians. Indeed, each patient might 
have several consulting physicians assisting in his or her care, and each consulting 
physician might be assisting with more than one patient. In summary, there are three 


Figure 7.9 A simple entity-re lotion ship diagram 
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Figure 7.10 One-to-one, one-to-many, and many-to-many relationships 
between entities of types X ond Y 
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fundamental types of relationships that might occur among two entities-one-to-one, 
one-to-many (or many-to-one depending on the point of view), and many-to-many, as 
summarised in Figure 7.10. 

Still another tool that has been used for years by software engineers is the data 
dictionary, which is a central repository of information about the data items appear- 
ing throughout a software system. This information includes the identifier used to 
reference each item; what constitutes valid entries in each item (Will the item always 
be numeric or perhaps always alphabetic? What will be the range of values that might 
be assigned to this item?); where the item is stored (Will the item be stored in a file 
or a database and, if so, which one?); and where the item is referenced in the software 
(Which modules will require the item's information?). 

One goal of constructing a data dictionary is to improve communication between 
the potential user of a software system and the software engineer charged with the 
task of converting the user's needs into requirements and specifications. In this con- 
text the construction of a data dictionary helps ensure that the fact that part numbers 
are not really numeric will be revealed during the analysis stage rather than being dis- 
covered late in the design or implementation stages. Another goal associated with 
the data dictionary is to establish uniformity throughout the system. It is usually by 
means of constructing the dictionary that redundancies and contradictions surface. For 
example, the item referred to as PartNumber in the inventory records might be the 
same as the Partld in the sales records. Moreover, the personnel department might 
use the term Name to refer to an employee while inventory records might contain 
the term Name in reference to a part. 



Software Engineering 


348 


Unified Modeling Language 

Dataflow diagrams, entity-relationship diagrams, and data dictionaries were tools in 
the software engineering arsenal well before the emergence of the object-oriented 
paradigm and have continued to find useful roles even though the imperative para- 
digm, for which they were originally developed, has faded in popularity. We turn now 
to the more modern collection of tools know as Unified Modeling Language (UML) 
that has been developed with the object-oriented paradigm in mind. The first tool 
that we consider within this collection, however, is useful regardless of the underly- 
ing paradigm since it attempts merely to capture the image of the proposed system 
from the user's point of view. This tool is the use case diagram-an example of which 
appears in Figure 7.11. 

A use case diagram depicts the proposed system as a large rectangle in which 
tasks performed by the system (called use cases) are represented as ovals and users 
of the system (called actors) are represented as stick figures (even though an actor 
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might not be a person). Thus, the diagram in Figure 7.11 indicates that the proposed 
Hospital Records System should perform the Retrieve Medical Record use 
case at the request of either a Physician or a Nurse. 

Whereas use case diagrams view a proposed software system from the outside, 
UML offers a variety of tools for representing the internal object-oriented design of a 
system. One of these is the class diagram, which is a notational system for repre- 
senting the structure of classes and relationships between classes (called associations 
in UML vernacular). We have already met a very similar concept in our discussion of 
entity-relationship diagrams. The distinction is that a class diagram represents rela- 
tionships between classes in an object-oriented design, whereas an entity-relationship 
diagram represents relationships between the less precise concept of "entities." 

Figure 7.12 shows how the relationships among the classes Physician, Patient, 
and Room (as described earlier in the entity-relationship diagram of Figure 7.9) would 
be represented in a UML class diagram. One point to make is that UML provides a 
more precise way of representing the details of a relationship. In particular, the one- 
to-many relationship between physicians and patients is indicated by the 1 and * at 
the appropriate ends of the relationship line (* indicates an arbitrary number) and the 
"one-to-one" relationship between patients and rooms is refined by the 0,1 notation 
at the patient end of the relationship line indicating that an instance of the relation- 
ship involves either no patients at all or exactly one patient (the former meaning that 
the room is empty), 

UML provides a special notation for representing associations in which one class 
is a generalization of another. An example is represented in Figure 7.13, which depicts 
the generalizations among the classes PatientRecord, Pat lentFinancialRecord, 
and PatientMedicalRecord. There the associations between the classes are repre- 
sented by arrows with hollow arrowheads, which is the UML notation for associa- 
tions that are generalizations. Note that we have chosen to represent each class by a 
rectangle containing the name, attributes, and methods of the class in the format 
introduced in Figure 7.4. This is UML's way of representing the internal characteris- 
tics of a class when that information is pertinent in a class diagram. The information 
portrayed in Figure 7.13 is that the class PatientRecord is a generalization of the 
class PatientFinancialRecord. That is, the class Patient FinancialRecord con- 
tains all the features of the class PatientRecord plus those features explicitly listed 
inside the PatientFinancialRecord rectangle. Thus, both the PatientFinan- 
cialRecord and the PatientMedicalRecord classes contain the patient's name and 
identification number, but the PatientFinancialRecord class also contains the 
patient's account balance and the ability to report the patient's payment history, 


Figure 7.12 A simple class diagram 
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Figure 7.13 A class diagram depicting generalizations 



whereas the PatientMedicalRecord class contains the patient's allergies and the 
ability to report the patient's medical history. 

Those who read the optional Section 6.5 will note that a natural way of imple- 
menting generalizations in an object-oriented programming environment is to use 
inheritance. However, many software engineers caution that inheritance is not appro- 
priate for all cases of generalization. The reason is that inheritance introduces a strong 
degree of coupling between the classes-a coupling that might not be desirable later 
in the software's life cycle. For example, since changes within a class are reflected 
automatically in all the classes that inherit from it, what might appear to be minor 
modifications during software maintenance can lead to unforeseen consequences. As 
an example, suppose a company opened a recreation facility for its employees, mean- 
ing that all people with membership in the recreation facility are employees. To 
develop a membership list for this facility, a programmer could use inheritance to 
construct a RecreationMember class from a previously defined Employee class. But, 
if the company later prospers and decides to open the recreation facility to depend- 
ents of employees or perhaps company retirees, then the embedded coupling between 
the Employee class and the RecreationMember class would have to be severed. Thus, 
inheritance should not be used merely for convenience but should be restricted to 
those cases in which the generalization being implemented is immutable. 

Class diagrams represent static features of a program's design. They do not rep- 
resent sequences of events that occur during execution. To express such dynamic fea- 



7.5 Tools of the Trade 35 J 


tuxes, UML provides collaboration diagrams, which we have already met in Figure 
7.5. One distinction between a collaboration diagram and a class diagram is that the 
former depicts objects and the latter depicts classes. In UML notation, object names 
are distinguished from class names by underlines. This is why the names in Figure 
7.5 are underlined. Another distinction between a collaboration diagram and a class 
diagram is that the former portrays a particular sequence of communications between 
objects rather than static associations between classes. Each collaboration diagram 
displays the communication sequence required to perform a single task. Thus, the 
complete design of a software system would involve many collaboration diagrams- 
one for each task the system will be required to perform. 

Finally, although they are not a part of UML, it is appropriate at this point to 
introduce the role of CRC (class-responsibility-collaboration) cards since they 
play an important role in validating object-oriented designs. A CRC card is simply a 
card on which the description of an object is written. The methodology of CRC cards 
is that the software designer produces a card for each object in a proposed system 
and then uses the cards to represent the objects in a simulation of the system-per- 
haps on a desktop or via a "theatrical" experiment in which each member of the design 
team holds a card and plays the role of the object as described by that card. Such sim- 
ulations (often called structured walkthroughs) have been found useful in identi- 
fying flaws in a design prior to the design's implementation. 

Design Patterns 

An increasingly powerful tool for software engineers is the growing collection of 
design patterns. A design pattern is a predeveloped method of solving a recurring 
problem in software design. For example, the Adapter pattern provides a solution to 
a problem that often occurs in constructing software from prefabricated modules. In 
particular, a prefabricated module might have the functionality needed to solve the 
problem at hand but might not have an interface that is compatible with the current 
application. In such cases the Adapter pattern can be used as a standard approach to 
wrapping that module inside another module that does nothing more than translate 
between the original module's interface and the outside world, thus allowing the orig- 
inal, prefabricated module to be used in the application. 

Another well-established design pattern is the Decorator pattern. It provides a 
means of designing a system that performs different combinations of the same activ- 
ities depending on the situation at the time. Such systems can lead to an explosion of 
options that, without careful design, can result in enormously complex software. How- 
ever, the Decorator pattern provides a standardized way of implementing such systems 
that leads to a manageable solution. 

The identification of recurring problems as well as the creation and cataloging of 
design patterns for solving them is an ongoing process in software engineering. The 
goal, however, is not merely to find solutions to design problems but to find high- 
quality solutions-solutions that provide flexibility later in the software life cycle. 
Thus, considerations of good design principles such as minimizing coupling and max- 
imizing cohesion play an important role in the development of design patterns. 
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The results of progress in design pattern development are reflected in the library of 
tools provided in today's software development packages such as the Java programming 
environments provided by Sun Microsystems and the .NET Framework provided by 
Microsoft. Indeed, many of the "templates" found in these "tool kits" are essentially design 
pattern skeletons that lead to ready-made, high-quality solutions to design problems. 

In closing, we should mention that the emergence of design patterns in software 
engineering is an example of how diverse fields can contribute to each other. The ori- 
gins of design patterns lie in the research of Christopher Alexander in architecture. 
His goal was to identify features that contribute to high quality architectural designs 
and then to develop design patterns that incorporated those features. Today, many of 
his ideas have been incorporated into software design and his work continues to be 
an inspiration for many software engineers. 


Questions 
& Exercises 


1 , Draw a dataflow diagram representing the flow of data that occurs when a 
patron checks a book out of a library. 

2, Draw an entity-relationship diagram representing airline companies, flights 
flown by each company, and the passengers on the various flights. 

3, Draw a use case diagram of a library records system. 

A. Draw a class diagram representing the relationship between travelers and 
the hotels in which they stay. 

5 . What role in the software engineering process do design patterns play? 


7.6 Testing 

Earlier we learned that software testing comes in two forms: validation testing and 
defect testing. In this section we concentrate on techniques of defect testing, the pur- 
pose of which is to reveal errors in the software. Unfortunately, such testing is inex- 
act at best. We cannot guarantee that a piece of software is correct via testing unless 
we run enough tests to exhaust all possible scenarios. Even in simple programs, there 
might be billions of different paths to be traversed. Thus, testing all possible paths 
within a complex program is an impossible task. 

On the other hand, software engineers have developed testing methodologies 
that improve the odds of revealing errors in software with a limited number of tests. 
One of these is based on the observation that errors in software tend to be clumped. 
That is, experience has shown that a small number of modules within a large soft- 
ware system tend to be more problematic than the rest. Thus, by identifying these 
modules and testing them more thoroughly, more of the system's errors can be dis- 
covered than if all modules were tested in a uniform, less-thorough manner. This is 
an instance of the proposition known as the Pareto principle, in reference to the 
economist and sociologist Vilfredo Pareto (1848-1923} who observed that a small 
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part of Italy's population controlled most of Italy's wealth. In the field of software engi- 
neering, the Pareto principle states that results can often be increased most rapidly 
by applying efforts in a concentrated area. 

Another software testing methodology, called basis path testing, is to develop a 
set of test data that insures that each instruction in the software is executed at least 
once. Techniques using an area of mathematics known as graph theory have been 
developed for identifying such sets of test data. Thus, although it might be impossible 
to insure that every path through a software system is tested, it is possible to insure that 
every statement within the system is executed at least once during the testing process. 

Techniques based on the Pareto principle and basis path testing rely on knowledge 
of the internal composition of the software being tested. They therefore fall within the 
category called glass-box testing-meaning that the software tester is aware of the 
interior structure of the software and uses this knowledge when designing the test. 
In contrast is the category called black-box testing, which refers to tests that do not 
rely on knowledge of the software's interior composition. In short, black-box testing 
is performed from the user's point of view. In black-box testing, one is not concerned 
with how the software goes about its task but merely with whether the software per- 
forms correctly in terms of accuracy and timeliness. 

One methodology that is often associated with black-box testing, called boundary 
value analysis, is to identify boundary points within the software's specifications and 
test the software at these points. For example, if the software is supposed to accept input 
values within a specified range, then the software would be tested at the lowest and high- 
est values in that range, or if the software is supposed to coordinate multiple activities, 
then the software would be tested on a collection of the most demanding activities. 

Another black-box testing methodology is to apply redundancy. Following this 
approach, two software systems for performing the same task are developed inde- 
pendently by different teams or even different companies. Then, the two systems 
are tested by applying them to the same data and comparing their results. Errors are 
indicted by discrepancies. Such redundancy techniques are often applied in space 
exploration systems. 

Still another methodology that falls within the black-box category is used by devel- 
opers of software aimed at the PC market [sometimes referred to as shrink-wrapped 
software in recognition of its packaging). This is to supply a segment of the intended 
audience with a preliminary version of the software, called a beta version. The goal 
is to learn how the software performs in real-life situations before the final version of 
the product is solidified and released to the market. 

The advantages of such beta testing extend far beyond the traditional discovery 
of errors. General customer feedback (both positive and negative) is obtained that 
might assist in refining market strategies. Moreover, early distribution of beta software 
assists other software developers in designing compatible products. For example, in 
the case of a new operating system, the distribution of a beta version encourages the 
development of compatible utility software so that the final operating system ulti- 
mately appears on store shelves surrounded by companion products. Finally, the exis- 
tence ofbeta software can generate a feeling of anticipation within the marketplace-an 
atmosphere that increases publicity and sales. 
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Questions 
& Exercises 


1. Is a successful software test one that does or does not find errors? 

, . what techniques would you propose using to identify the modules within a 
system that should receive more thorough testing than others? 

3. What would be a good test to perform on a software package that was 
designed to sort a list of no more than 100 entries? 


7.7 Documentation 

A software system is of little use unless people can learn to use and maintain it. 
Hence, documentation is an important part of a software package, and its development 
is, therefore, an important topic in software engineering. 

Software documentation serves three purposes, leading to three categories of doc- 
umentation: user documentation, system documentation, and technical documenta- 
tion. The purpose of user documentation is to explain the features of the software 
and describe how to use them. It is designed to be read by the user of the software 
(hence its name) and is therefore written in the terminology of the application. 

Today, user documentation is recognized as an important marketing tool. Good 
user documentation combined with a well-designed user interface makes a software 
package accessible and thus increases its sales. Recognizing this, many software devel- 
opers hire technical writers to produce this part of their product, or they provide pre- 
liminary versions of their products to independent authors so that how-to books are 
available in book stores when the software itself is released to the public. 

User documentation traditionally takes the form of a physical book or booklet, but 
in many cases the same information is included as part of the software itself. This 
allows a user to refer to the documentation while using the software. In this case the 
information might be broken into small units, sometimes called help packages, which 
might appear on the monitor screen automatically if the user dallies too long between 
commands (a feature that, unfortunately, can become annoying). 

The purpose of system documentation is to describe the software's internal 
composition so that the system can be maintained later in its life cycle. A major com- 
ponent of system documentation is the source version of all the programs in the soft- 
ware package. It is important that these programs be presented in a readable format, 
which is why software engineers support the use of well-designed, high-level pro- 
gramming languages, the use of comment statements for annotating a program, and 
a modular design that allows each module to be presented as a coherent unit. In fact, 
most companies that produce software products have adopted conventions for their 
employees to follow when writing programs. These include indentation conventions 
for organizing a program on the written page, naming conventions to establish a dis- 
tinction between names of variables, constants, objects, classes, etc., and documen- 
tation conventions to ensure that all programs are sufficiently documented. Such 
conventions establish uniformity throughout a company's software, which ultimately 
simplifies the software maintenance process. 
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Another component of system documentation is a record of the design docu- 
ments describing the system’s specifications and how these specifications were 
obtained. Creating this documentation is an ongoing process that starts with the ini- 
tial analysis during the software’s development. Being an ongoing process, the creation 
of this documentation leads to a conflict between the goals of software engineering 
and human nature. It is highly likely that the initial specifications and the initial soft- 
ware design will change during the development process. At issue is the temptation 
to make these changes without updating the earlier design documents. The result is 
a strong possibility that the documents will be incorrect and hence their use in the 
final documentation misleading. (This, in fact, is a major issue in many open-source 
development projects where the individual contributors are usually more interested 
in enhancing the system than in documenting their enhancements.) 

Herein lies an important benefit of CASE tools. They make such tasks as redraw- 
ing diagrams and updating data dictionaries much easier than with manual methods. 
Consequently, updates are more likely to be made and the final documentation is 
more likely to be accurate. 

The purpose of technical documentation is to describe how a software system 
should be installed and serviced (such as adjusting operating parameters, installing 
updates, and reporting problems back to the software's developer). Technical docu- 
mentation of software is analogous to the documentation provided to mechanics in the 
automobile industry. This documentation does not discuss how the car was designed 
and constructed (analogous to system documentation), nor does it explain how to 
drive the car and operate its heating/cooling system (analogous to user documenta- 
tion). Instead, it describes how to service the car’s components, for example, how to 
replace the transmission or how to track down an intermittent electrical problem. 

The distinction between technical documentation and user documentation is 
blurred in the case of software in the PC arena since the user is often the person who 
also installs and services the software. However, in multiuser environments, the dis- 
tinction is sharper. There, technical documentation is used by a system administrator 
who is responsible for servicing all the software under his or herjurisdiction, allow- 
ing the users to access the software packages as abstract tools. 


1. In what forms can software be documented? 

2. At what phase (or phases) in the software life cycle is system documentation 
prepared? 

3. Which is more important, a program or its documentation? 


Questions 
& Exercises 


7.8 Software Ownership and Liability 

Most would agree that a company or individual should be allowed to recoup, and profit 
from, the investment needed to develop quality software. Many argue that without a 
means of protecting this investment, it is likely that few would be willing to undertake 
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the task of producing the software our society desires. But questions of software own- 
ership and ownership rights can fall between the cracks of well-established copyright 
and patent laws. These laws were developed to allow the developer of a "product" to 
release that product to the public while protecting his or her ownership rights, but the 
characteristics of software have repeatedly challenged the courts in their efforts to 
apply copyright and patent principles to issues of software ownership. 

Copyright laws were originally established to protect an author's rights to literary 
works. In this case, the value of the product is in how ideas are expressed rather than 
in the ideas themselves. The value in a poem is in the rhythm, style, and format of 
the poem rather than the subject matter; the value of a novel is in the author's pres- 
entation of the story rather than the story itself. Thus a poet's or a novelist's invest- 
ment can be protected by giving him or her ownership of that particular expression 
of the idea, but not the idea itself. Another person is free to express the same idea as 
long as that expression does not have "substantial similarity" to that of the original. 

In short, copyright laws were developed to protect form rather than function, but 
the value of software is often in its function rather than its form. Thus, a straightfor- 
ward application of copyright law would tend not to protect a software developer's 
investment. In general, courts have recognized this problem and have been recep- 
tive to attempts to give software developers fair protection under existing copyright 
law. The problem is in establishing the meaning of "substantial similarity" in the case 
of software. 

It would be frivolous to claim that two programs were substantially similar merely 
because they perform the same task. To do so would lead to the conclusion that there 
could he only one operating system since the task of any operating system is to coor- 
dinate the machine's activities and its allocation of resources. But what if the under- 
lying structure (as represented by structure charts or collaboration diagrams) of two 
programs is the same? This might or might not indicate plagiarism. If, for example, 
the common structure was the result of applying a well-known design pattern, then 
the similarity might merely reflect that both programs were well designed. Likewise, 
the fact that two programs carry out a task in the same manner might simply reflect 
the reality that there is an obvious algorithm for the particular application rather than 
a breach of copyright. 

To tackle such problems, courts have applied techniques called filtering to sepa- 
rate similarities that do not indicate copyright infringement from those that might. The 
filtering process is to identify properties that do not imply infringement, remove those 
properties, and then base the judgment of infringement on what is left. In terms of 
software, some of the items that have been argued for filtration (and thus not subject 
to copyright protection) include features determined by standards, characteristics 
that are essentially dictated by logical consequences of the program's purpose, and 
components that are a part of the public domain. (This approach to determining sub- 
stantial similarity is the fundamental idea behind more precise procedures known in 
legal jargon as successive filtration and the abstractions test.) 

So, if similarities in these areas would not constitute copyright infringement, 
what type of similarities would? Some plaintiffs have successfully argued that the 
look and feel of a software system should be protected under copyright law. Although 
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the phrase look andfeel was not used until 1985, the concept has its roots as early as 
the 1960s when IBM introduced its System/360 series of computers. This series con- 
sisted of a variety of machines ranging from designs for small-business applications 
to large machines for businesses with significant needs. All these machines were sup- 
plied with operating systems that communicated with their environments in essen- 
tially the same manner. That is, the entire series of computers had a standardized 
interface with the user. Thus, as a business grew, it could change to a larger machine 
in the 360 series without major reprogramming and retraining efforts. Indeed, the 
look (meaning the appearance projected by the system software) and the feel (mean- 
ing the manner in which the user interacted with the system software) were the same 
for all machines in the 360 series. 

Today, the advantages of standardized interfaces are well recognized and sought 
after throughout the software spectrum. When the interface designed by one company 
becomes popular, it becomes advantageous for competing companies to design their sys- 
tems to look and feel like the well-known one. This similarity makes it easier for users 
of the well-known system to convert to a competitor's system, even though the interior 
designs of the two systems might be quite different. Companies facing such competi- 
tive practices have sought protection under copyright laws by claiming ownership of 
the look and feel of the original system. After all, the look and feel of a software pack- 
age has many of the characteristics of the properties protected by copyright laws. 

An early test of the look and feel argument was in 1987, when Lotus Development 
Corporation sued Mosaic Software, claiming that the latter had copied the look and feel 
of the Lotus 1 -2-3 spreadsheet system. The suit was successful. In more recent cases, 
however, look and feel arguments have met with mixed results. If, for example, a 
defendant can convince a court that the look and feel of a system is so common that 
it has become a standard in the public domain, then the look and feel becomes sub- 
ject to filtration and would not be protected by copyright. 

Software is somewhat unique in that it is a commodity to which both copyright 
and patent law have been applied- a fact that has made courts reluctant at times to 
interpret copyright protection too broadly for fear of overlapping patent law. 

As with copyright, patents also suffer fundamental problems when used to pro- 
tect software ownership lights. One obstacle is the long-standing principle that no 
one can own natural phenomena such as laws of physics, mathematical formulas, 
and thoughts-a collection that, courts have often held, include algorithms. There 
are, however, increasing numbers of cases in which software developers have suc- 
cessfully obtained patents, one example being the encryption algorithm known as 
RSA that is heavily used in many of today's public key encryption systems. 

Another drawback to the use of patents to protect software ownership rights is that 
obtaining a patent is an expensive and time-consuming process, often taking several 
years. During this time a software product could become obsolete, and until the patent 
is granted the applicant has only questionable authority to exclude others from appro- 
priating the product. 

Copyright and patent laws are designed to protect the rights of creators and inven- 
tors so that they will be more likely to make their achievements known to the pub- 
lic. In contrast, trade secret laws provide a means of restricting the distribution of 
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ideas. Designed to maintain ethical conduct between competing businesses, these 
laws protect against improper disclosure or wrongful appropriation of a company's 
internal accomplishments. Companies often attempt to protect their trade secrets by 
means of written nondisclosure agreements in which personnel with access to com- 
pany secrets agree not to disclose their knowledge to others. Courts have generally 
upheld such agreements. 

Finally, we should address the issue of liability. To protect themselves against lia- 
bility, software developers often accompany their product with disclaimers in which 
they state the limitations of their liability. Such statements as Tn no event will Com- 
pany X be liable for any damages arising out of the use of this software" are common. 
Courts, however, rarely recognize a disclaimer if the plaintiff can show negligence 
on the part of the defendant. Thus liability cases tend to focus on whether the defen- 
dant used a level of care compatible with the product being produced. A level of care 
that might be deemed acceptable in the case of developing a word processing system 
might be considered negligent when developing software to control a nuclear reactor. 
Consequently, one of the best defenses against software liability claims is to apply 
sound software engineering principles during the software’s development, using a 
level of care compatible with the software's application. 


Questions 
& Exercises 


1. what test can be applied to decide whether one program is substantially sim- 
ilar to another? 

2. In what ways are copyright, patent, and trade secret laws designed to benefit 
society? 

3. To what extent are disclaimers not recognized by the courts? 


Chapter Review Problems 


(Asterisked problems are associated with optional sections.) 


1. Give an example of how efforts in the develop- 
ment of software can pay dividends later in 
software maintenance. 

2. What is evolutionary prototyping? 

3. In each of the following cases identify 
whether the process more closely follows the 
waterfall model or the evolutionary proto- 
typing model. Explain your answers. 

a. The construction of a large building 

b. Learning through scientific research 


c. Writing a term paper 

d. Obtaining a formal education in a university 

e. Obtaining an informal education through 
life experience 

4. Explain how the lack of metrics for measuring 
certain software properties affects the soft- 
ware engineering discipline. 

5. Suppose you had a metric for measuring the 
complexity of a software system. Would that 
metric be cumulative in the sense that the 
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complexity of a complete system would be the 
sum of the complexities of its parts? Explain 
your answer. 

6. Suppose you had a metric for measuring the 
complexity of a software system. Would that 
metric be commutative in the sense that the 
complexity of a complete system would be the 
same if it were originally developed with fea- 
ture X and had feature Y added later or if it 
were originally developed with feature Y and 
had feature X added later? Explain your 
answer. 

7. How does software engineering differ from 
other, more traditional fields of engineering 
such as electrical and mechanical engineering? 

8. a. Identify a disadvantage of the traditional 

waterfall model for software development, 

b. Identify an advantage of the traditional 
waterfall model for software development. 

9. How does the establishment of codes of ethics 
and professional conduct aid in the develop- 
ment of quality software? 

1 0. Describe how the use of constants rather than 
literals can simplify software maintenance. 

1 1 . What is the difference between coupling and 
cohesion? Which should be minimized and 
which should be maximized? Why? 

1 2. Select an object from everyday life and ana- 
lyze its components in terms of functional or 
logical cohesion. 

13. Contrast the coupling between two program 
units obtained by a simple goto statement 
with the coupling obtained by a procedure 
call. 

1 4. m Chapter 6 we learned that parameters can 
be passed to procedures by value or by refer- 
ence. Which provides the more complex form 
of data coupling? Explain your answer. 

15. what problems could arise during the modifi- 
cation stage if a large program was designed in 
such a way that all of its data elements were 
global? 


*16. in an object-oriented program, what does 

declaring an instance variable to be public or 
private indicate about data coupling? 

'17. identify a problem involving data coupling 
that can occur in the context of parallel 
processing. 

1 8. Answer the following questions in relation to 
the accompanying structure chart: 



a. To which module does module Y return 
control? 

b. To which module does module Z return 
control? 

c. Are modules W and X linked via control 
coupling? 

d. Are modules W and X linked via data 
coupling? 

e. What data is shared by both module W and 
module Y? 

f. In what way are modules Y and X related? 

19. Answer the following questions in relation to 

the accompanying structure chart: 



a. What is different between the way modules 
A and B use data items x and y? 

b. If one of the modules was in charge of 
obtaining data item z from a user at a 
remote terminal, which module would that 
apparently be? 
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20. Draw a simple class diagram representing the 
relationship between magazine publishers, 
magazines, and subscribers. 

2 1 . Draw a collaboration diagram representing the 
communication sequence that would ensue 
when an instance of a utility company sends a 
bill to an instance of a customer. 

22. What is the difference between a class dia- 
gram and a collaboration diagram? 

23. WhatisUML? 

24. Using a structure chart, represent the proce- 
dural structure of a simple inventory/account- 
ing system for a small store (perhaps a privately 
owned curio shop in a resort community). 
What modules in your system must be modi- 
fied because of changes in sales tax laws? 

What modules would need to be changed if 
the decision is made to maintain a record of 
past customers so that advertising can be 
mailed to them? 

25. Design an object-oriented solution to the 
previous problem and represent it by a class 
diagram. 

26. Identify some design patterns in fields other 
than software engineering. 

27. Summarize the role of design patterns in soft- 
ware engineering. 

26. To what extent are the control structures in a 
typical high-level programming language ( i f - 
then-else, while, etc.) small-scale design 
patterns? 

29. Draw a simple dataflow diagram depicting the 
flow of data that occurs in an automated 
inventory system when a sale is made. 

30. Contrast the information represented in 
dataflow diagrams with that in structure 
charts. 

31. What is the difference between a one-to-many 
relationship and a many-to-many relationship? 

32. Give an example of a one-to-many relationship 
that is not mentioned in this chapter. Give an 


example of a many-to-many relationship that 
is not mentioned in this chapter. 

33. Draw an entity-relationship diagram repre- 
senting the relationships between the cooks, 
waitresses, customers, and cashiers in a 
restaurant. 

34. Draw an entity-relationship diagram repre- 
senting the relationships between magazines, 
publishers of magazines, and subscribers to 
magazines. 

35. Draw a simple use case diagram depicting the 
ways in which a library patron uses a library. 

36. Extend the collaboration diagram in Figure 7.5 
to show the collaboration sequence that would 
occur if PlayerB's return is successful but 
PlayerA fails to return the volley successfully. 

37. In each of the following cases, identify 
whether the activity relates to a structure 
chart, a dataflow diagram, an entity-relation- 
ship diagram, or a data dictionary. 

a. Identifying the data pertinent to the system 
to be developed. 

b. Identifying the relationship between the var- 
ious items of data appearing in the system. 

c. Identifying the characteristics of each item 
of data in the system. 

d. Identifying which items of data are shared 
among the various parts of the system. 

38. In each of the following cases, identify whether 
the activity relates to a collaboration diagram, a 
use case diagram, or a class diagram. 

a. Identifying the way in which users will 
interact with the system. 

b. Identifying the relationship between classes 
in the system. 

c. Identifying the manner in which objects 
will interact to accomplish a task. 

39. What is the difference between a class dia- 
gram and an entity-relationship diagram? 

40. Draw a class diagram depicting the fact that 
the classes Truck and Automobile are general- 
izations of the class Vehicle. 
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4 1 . Explain why inheritance is not always the best 
way to implement class generalizations. 

42. which of the following involve the Pareto prin- 
ciple? Explain your answers. 

a. One obnoxious person can spoil the party 
for everyone. 

b. Each radio station concentrates on a partic- 
ular format such as hard rock music, classi- 
cal music, or talk. 

c. In an election, candidates are wise to focus 
their campaigns on the segment of the elec- 
torate that has voted in the past. 

43 Do software engineers expect large software 
systems to be homogeneous or heterogeneous 
in error content? Explain your answer. 

44 Basis path testing is a methodology by which 
every instruction in a program is executed at 
least once. How does this differ from ensuring 
that every path is executed at least once? 

45. What is the difference between black-box 
testing and glass-box testing? 

46. Give some analogies of black-box and glass-box 
testing that occur in fields other than software 
engineering. 


47 . How does open-source development differ 
from beta testing? (Consider glass-box testing 
versus black-box testing.) 

48. Is open-source development a top-down or 
bottom-up methodology? Explain your answer. 

49 . Suppose that 100 errors were intentionally 
placed in a large software system before the 
system was subjected to final testing. 
Moreover, suppose that 200 errors were dis- 
covered and corrected during this final testing, 
of which 50 errors were from the group inten- 
tionally placed in the system. If the remaining 
50 known errors are then corrected, how 
many unknown errors would you estimate are 
still in the system? Explain why. 

50. In what way do traditional copyright laws fail 
to safeguard the investments of software 
developers? 

51. In what way do traditional patent laws fail 
to safeguard the investments of software 
developers? 


Social Issues 


The following questions are intended as a guide to the ethical/social/legal issues asso- 
ciated with the field of computing. The goal is not merely to answer these questions. 
You should also consider why you answered as you did and whether your justifications 
are consistent from one question to the next. 

1. a. Mary Analyst has been assigned the task of implementing a system with 
which medical records will be stored on a computer that is connected to a 
large network. In her opinion the design for the system's security is flawed 
but her concerns have been overruled for financial reasons. She has been 
told to proceed with the project using the security system that she feels is 
inadequate. What should she do? Why? 

b. Suppose that Mary Analyst implemented the system as she was told, 
and now she is aware that the medical records are being observed by 
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unauthorized personnel. What should she do? To what extent is she liable 
for the breach of security? 

c. Suppose that instead of obeying her employer, Mary Analyst refuses to pro- 
ceed with the system and blows the whistle by making the flawed design 
public, resulting in a financial hardship for the company and the loss of 
many innocent employees' jobs. Were Mary Analyst’s actions correct? 

What if it turns out that, being only a part of the overall team, Mary 
Analyst was unaware that sincere efforts were being made elsewhere 
within the company to develop a valid security system that would be 
applied to the system on which Mary was working? How does this change 
your judgment of Mary's actions? (Remember, Mary's view of the situation 
is the same as before.) 

2. When large software systems are developed by many people, how should lia- 
bilities be assigned? Is there a hierarchy of responsibility? Are there degrees 
of liability? 

3. We have seen that large, complex software systems are often developed by 
many individuals, few of whom might have a complete picture of the entire 
project. Is it ethically proper for an employee to contribute to a project with- 
out full knowledge of its function? 

4. To what extent is someone responsible for how his or her accomplishments 
are ultimately applied by others? 

5. In the relationship between a computer professional and a client, is it the pro- 
fessional's responsibility to implement the client's desires or to direct the 
client's desires? What if the professional foresees that a client's desires could 
lead to unethical consequences? For example, the client might wish to cut cor- 
ners for the sake of efficiency, but the professional might foresee a potential 
source of erroneous data or misuse of the system if those shortcuts are taken. 
If the client insists, is the professional free of responsibility? 

6. What happens if technology begins to advance so rapidly that new inventions 
are superseded before the inventor has time to profit from the invention? Is 
profit necessary to motivate inventors? How does the success of open-source 
development relate to your answer? Is free quality software a sustainable 
reality? 

7. is the computer revolution contributing to, or helping to solve, the world's 
energy problems? What about other large-scale problems such as hunger and 
poverty? 

6. Will advances in technology continue indefinitely? What, if anything, would 
reverse society's dependency on technology? What would be the result of a 
society that continues to advance technology indefinitely? 

9. Do you agree with the statement that quality software would not be produced 
if the producers were not allowed to profit from their efforts? If so, what kind 
of "profit" is required? Does your answer apply to products other than soft- 
ware-such as art, services, or labor? 
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In this chapter we investigate how data 
arrangements other than the cell-by-cell 
organization provided by a computer's 
main memory can be simulated-a sub- 
ject known as data structures. The goal is 
to allow the data's user to access collec- 
tions of data as abstract tools rather than 
force the user to think in terms of the 
computer's main memory organization. 
Our study will show how the desire to 
construct such abstract tools leads the 
concept of objects and object-oriented 
programming. 
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We introduced the concept of data structure in Chapter 6, where we learned that high- 
level programming languages provide techniques by which programmers can express 
algorithms as though the data being manipulated were stored in ways other than the 
cell-by-cell arrangement provided by a computer's main memory. We also learned that 
the data structures supported by a programming language are known as primitive 
structures. In this chapter we will explore techniques by which data structures other 
than a language's primitive structures can be constructed and manipulated- a study 
that will lead us from traditional data structures to the object-oriented paradigm. An 
underlying theme throughout this progression is the construction of abstract tools. 


8.1 Data Structure Fundamentals 

We begin our study by introducing some basic data structures that will serve as exam- 
ples in future sections. Also, we isolate three topics that are closely associated with 
the subject of data structures: abstraction, the distinction between static and dynamic 
structures, and the concept of a pointer. 


Basic Data Structures 

In Section 6.2, we learned about the data structures known as homogeneous and het- 
erogeneous arrays. Recall that a homogeneous array is a "rectangular" block of data 
whose entries are of the same type. In particular, a two-dimensional homogeneous array 
consists of rows and columns in which positions are identified by pairs of indices-the 
first index identifies the row associated with the position, the second index identifies the 
column. An example would be a rectangular array of numbers representing the monthly 
sales made by members of a sales force-thc entries across each row representing the 
monthly sales made by a particular member and the entries down each column repre- 
senting the sales by each member for a particular month. Thus, the entry in the third row 
and first column would represent the sales made by the third salesperson in January. 

In contrast to a homogeneous array, recall that a heterogeneous array is a block 
of data items that might be of different types. The items within the block are usually 
called components. An example of a heterogeneous array would be the block of data 
relating to a single employee, the components of which might be the employee's 
name (of type character), age (of type integer), and skill rating (of type real). 

Other basic data structures that will serve as useful examples in this chapter include 
lists and trees. A list is a collection whose entries are arranged sequentially (Figure 8.1a). 
Examples include guest lists, shopping lists, class enrollment lists, and inventory lists. The 
beginning of a list is called the head of the list. The other end of a list is called the tail. 

By restricting the manner in which entries of a list are accessed, we obtain two 
special types of lists known as stacks and queues. A stack is a list in which entries are 
removed and inserted only at the head (Figure 8.1b). Following colloquial terminology, 
the head of a stack is called the top of the stack. The tail of a stack is called its bottom 
or base. An example is a stack ofbooks on a table-abook is added by placing it on 
top of the stack, and a book is removed by lifting it off the top of the stack. Inserting 
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Figure 8.1 Lists, stacks, and queues 


Queue 



a. A list of names b. A stack of books c. A queue of people 


a new entry at the top of a stack is called pushing an entry. Removing an entry from 
the top of a stack is called popping an entry. Note that the last entry placed on a 
stack will always be the first entry removed- an observation that leads to a stack being 
known as a last-in, first-out, or LIFO (pronounced "LIE-foe") structure. 

A queue is a list in which entries are removed only at the head and new entries 
are inserted only at the tail. An example is a line, or queue, of people waiting to buy 
tickets at a theater (Figure 8.1c) -the person at the head of the queue is served while 
new arrivals step to the rear (or tail) of the queue. We have already met the queue 
structure in Section 1 of Chapter 3 where we saw that a batch processing operating 
system stores the jobs waiting to be executed in a queue called the job queue. There 
we also learned that, in contrast to a stack, the first entry inserted in a queue will be 
at the head when it comes time to remove an entry, meaning that a queue is a first- 
in, first-out, or FIFO (pronounced "FIE-foe") structure. 

Finally, a tree is a collection whose entries have a hierarchical organization sim- 
ilar to that of an organization chart of a typical company (Figure 8.2). The president 


Figure 8.2 An example of an organization chart 


President 



Vice-President Vice-President Vice-President 

of Sales of Finance of Services 










Data Abstractions 


368 


is represented at the top, with lines branching down to the vice presidents, who arc 
followed by regional managers, and so on. To this intuitive definition of a tree struc- 
ture we impose one additional constraint, which (in terms of an organization chart) 
is that no individual in the company reports to two different superiors. That is, dif- 
ferent branches of the organization do not merge at a lower level. (We have already 
seen examples of trees in Section 6.4 where they appeared in the form of parse trees.) 

Each position in a tree is called a node (Figure 8.3). The node at the top is called 
the root node (if we turned the drawing upside down, this node would represent the 
base or root of the tree). The nodes at the other extreme are called terminal nodes 
(or sometimes leaf nodes). We often refer to the number of nodes in the longest path 
from the root to a leaf as the depth of the tree. In other words, the depth of a tree is 
the number of horizontal layers within it. 

At times we refer to tree structures as though each node gives birth to those nodes 
immediately below it. In this sense, we often speak of a node's ancestors or descen- 
dants. We refer to its immediate descendants as its children and its immediate ances- 
tor as its parent. Moreover, we speak of nodes with the same parent as being siblings. 
A tree in which each parent has no more than two children is called a binary tree. 

If we select any node in a tree, we find that that node together with the nodes 
below it also have the structure of a tree. We call these smaller structures subtrees. 
Thus, each child node is the root of a subtree below the child’s parent. Each such sub- 
tree is called a branch from the parent. In a binary tree, we often speak of a node's 
left branch or right branch in reference to the way the tree is displayed. 


Figure 8.3 Tree terminology 
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Abstraction Again 

The data structures defined above are structures that are often associated with data. 
However, a computer's main memory is not organized as lists, stacks, queues, and 
trees but is instead organized as a sequence of addressable memory cells. Thus, all 
other structures must be simulated. How this simulation is accomplished is the sub- 
ject of this chapter. For now we merely point out that organizations such as stacks, 
queues, and trees are abstract tools that are created so that users of the data can be 
shielded from the details of actual data storage (memory cells and addresses) and can 
be allowed to access information as though it were stored in a more convenient form. 

The term user in this context does not necessarily refer to a human. Instead, the 
meaning of the word depends on our perspective at the time. If we are thinking in 
terms of a person using a PC to maintain bowling league records, then the user is a 
human. In this case, the application software (perhaps a spreadsheet software pack- 
age) would be responsible for presenting the data in an abstract form convenient to 
the human- mo st likely as a homogeneous array. If we are thinking in terms of a 
server on the Internet, then the user might be a client. In this case, the server would 
be responsible for presenting data in an abstract form convenient to the client. If we 
are thinking in terms of the modular structure of a program, then the user would be 
any module requiring access to the data. In this case, the module containing the data 
would be responsible for presenting the data in an abstract form convenient to the 
other modules. In each of these scenarios, the common thread is that the user has the 
privilege of accessing data as an abstract tool. 


Static Versus Dynamic Structures 

An important distinction in constructing abstract data structures is whether the struc- 
ture being simulated is static or dynamic, that is, whether the shape or size of the 
structure changes over time. For example, if the abstract tool is a list of names, it is 
important to consider whether the list will remain a fixed size throughout its exis- 
tence or expand and shrink as names are added and deleted. 

As a general rule, static structures are more easily managed than dynamic ones. If 
a structtire is static, we need merely to provide a means of accessing the various data items 
in the structure and perhaps a means of changing the values at designated locations. 
But, if the structure is dynamic, we must also deal with the problems of adding and delet- 
ing data entries as well as finding the memory space required by a growing data struc- 
ture. In the case of a poorly designed structure, adding a single new entry could result 
in a massive rearrangement of the structure, and excessive growth could dictate that the 
entire structure be transferred to another memory area where more space is available. 


Pointers 

Recall that the various cells in a machine's main memory are identified by numeric 
addresses. Being numeric values, these addresses themselves can be encoded and 
stored in memory cells. A pointer is a storage area that contains such an encoded 
address. In the case of data structures, pointers are used to record the location where 
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data items are stored. For example, if we must repeatedly move an item of data from 
one location to another, we might designate a fixed location to serve as a pointer. 
Then, each time we move the item, we can update the pointer to reflect the new 
address of the data. Later, when we need to access the item of data, we can find it by 
means of the pointer. Indeed, the pointer will always "point" to the data. 

We have already encountered the concept of a pointer in our study of CPUs in 
Chapter 2. There we found that a register called a program counter is used to hold the 
address of the next instruction to be executed. Thus, the program counter plays the 
role of a pointer. In fact, another name for a program counter is instruction pointer. 
The URLs used to link hypertext documents can also be considered examples of the 
pointer concept, except that URLs are pointers to locations on the Internet rather 
than to locations in main memory. 

As an example of the application of pointers, suppose we have a list of novels stored 
in a computer's memory alphabetically by tide. Although convenient in many applica- 
tions, this arrangement makes it difficult to find all the novels by a particular author- 
they are scattered throughout the list. To solve this problem, we can reserve an additional 
memory cell within each block of cells representing a novel and use this cell as a pointer 
to another block representing a book by the same author. In this manner the novels with 
common authorship can be linked in a loop (Figure 8.4). Once we find one novel by a 
given author, we can find all the others by following the pointers from one book to another. 

Many modern programming languages include pointers as a primitive data type. 
That is, they allow the declaration, allocation, and manipulation of pointers, in ways 
reminiscent of integers and character strings. Using such a language, a programmer 
can design elaborate networks of data within a machine's memory where pointers 
are used to link related items to each other. 


1. Give examples (outside of computer science) of each of the following struc- 
tures: list, stack, queue, and tree. 

2. Suppose a tree has four nodes A, B, C, and D. If A and C are siblings and D's 
parent is A, which nodes are leaf nodes? Which node is the root? 
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3. Describe an application that you would expect to involve a static data struc- 
ture. Then describe an application that you would expect to involve a 
dynamic data structure. 

4 . Describe contexts outside of computer science in which the pointer concept 
occurs. 


8.2 Implementing Data Structures 

Let us now consider ways in which the data structures discussed in the previous sec- 
tion can be stored in a computer's main memory. 

Storing Arrays 

We begin with techniques for storing arrays. As we saw in Section 6.2, these structures 
are often provided as primitive structures in high-level programming languages. Our 
goal here is to understand how programs that deal with such structures are translated 
into machine-language programs that manipulate data stored in main memory. 

Homogeneous Arrays Suppose we want to store a sequence of 24 hourly tem- 
perature readings, each of which requires one memory cell of storage space. Moreover, 
suppose we want to identify these readings by their positions in the sequence. That 
is, we want to be able to access the first reading or the fifth reading. In short, we want 
to manipulate the sequence as though it were a one-dimensional homogeneous array. 

We can obtain this goal merely by storing the readings in a sequence of 24 memory 
cells with consecutive addresses. Then, if the address of the first cell in the sequence is 
x, the location of any particular temperature reading can be computed by subtracting one 
from the index of the desired reading and then adding the result to x. In particular, the 
fourth reading would be located at address X + ( 4 - 1), as shown in Figure 8.5. 

Figure 8.5 The array of temperature readings stored in memory starting at address x 
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Implementing Contiguous Lists 

The primitives for constructing and manipulating arrays that are provided in 
most high-level programming languages are convenient tools for constructing 
and manipulating contiguous lists. If the entries of the list are all the same prim- 
itive data type, then the list is nothing more than a one-dimensional homoge- 
neous array. A slightly more involved example is a list often names, each of 
which is no longer than eight characters, as discussed in the text. In this case, a 
programmer could construct the contiguous list as a two-dimensional array of 
characters with ten rows and eight columns, which would produce the structure 
represented in Figure 8.6 (assuming that the array is stored in row-major order). 

Many high-level languages incorporate features that encourage such imple- 
mentations of lists. For example, suppose the two-dimensional array of charac- 
ters proposed above was called Member List. Then in addition to the traditional 
notation in which the expression MemberList [ 3 , 5 ] refers to the single char- 

acter in the third row and fifth column, some languages adopt the expression 
MemberList [ 3 ] to refer to the entire third row, which would be the third 
entry in the list. 


This technique is used by most translators of high-level programming languages 
to implement one-dimensional homogeneous arrays. When the translator encounters 
a declaration statement such as 

int Readings [ 2 4 ] ; 

declaring that the term Readings is to refer to a one-dimensional array of 24 integer 
values, the translator arranges for 24 consecutive memory cells to be set aside. Later 
in the program, if it encounters the assignment statement 

Readings [4] <- 67; 

requesting that the value 67 be placed in the fourth entry of the array Readings, the 
translator builds the sequence of machine instructions required to place the value 67 
in the memory cell at address x + (4 - 1), where * is the address of the first cell in the 
block associated with the array Readings. In this manner, the programmer is allowed 
to write the program as though the temperature readings were actually stored in a one- 
dimensional array. (Caution: In the languages C, C + + , C# and Java, array indices 
start at 0 rather than 1, so the fourth reading would be referenced by Readings [3]. 
See Question/Exercise 3 at the end of this section.) 

Now suppose we want to record the sales made by a company's sales force dur- 
ing a one-week period. In this case, we might envision the data arranged in a two- 
dimensional homogeneous array, where the values across each row indicate the sales 
made by a particular employee, and the values down a column represent all the sales 
made during a particular day. 
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Ti)<ica>i riir; ( Hi.L«j this t i a : d , « \ first recognize: that the array is static in the sense 
that its size does not vary as updates are made. We can therefore calculate the amount 
of storage area needed for the entire array and reserve a block of contiguous mem- 
ory cells of that size. Next, we store the data in the array row by row. Starting at the 
first cell of the reserved block, we store the values from the first row of the array into 
consecutive memory locations; following this, we store the next row, then the next, 
and so on (Figure 8.6). Such a storage system is said to use row major order in con- 
trast to column major order in which the array is stored column by column. 

With the data stored in this manner, let us consider how we could find the value 
in the third row and fourth column of the array. Envision that we are at the first loca- 
tion in the reserved block of the machine's memory. Starting at this location, we find 
the data in the first row of the array followed by the second, then the third, and so on. 
To get to the third row, we must move beyond both the first and second rows. Since 
each row contains five entries (one for each day of the week from Monday through 
Friday), we must move beyond a total of 10 entries to reach the first entry of the third 
row. From there, we must move beyond another three entries to reach the entry in 
the fourth column of the row. Altogether, to reach the entry in the third row and 
fourth column, we must move beyond 13 entries from the beginning of the block. 

The preceding calculation can be generalized to obtain a formula for converting ref- 
erences in terms of row and column positions into actual memory addresses. In partic- 
ular, if we let c represent the number of columns in an array (which is the number of 
entries in each row), then the address of the entry in the ith row and;th column will be 

x + (c x (i - 1)) + O'- 1) 

where x is the address of the cell containing the entry in the first row and first col- 
umn. That is, we must move beyond t - 1 rows, each of which contains c entries, to 
reach the ith row and then; - 1 more entries to reach thejth entry in this row. In our 
prior example c = 5,i = 3, and; = 4, so if the array were stored starting at address x, 

Figure 8.6 A two-dimensional array with four rows and five columns stored in row major order 


Conceptual array 



Entryfrom 4th column in Row 3 


374 Data Abstractions 


then the entry in the third row, fourth column would be at address x + (5 x (3 - 1)) + 
(4 - 1) -= x + 13. The expression (c x (i-lj) + (j - 1) is sometimes called the address 
polynomial. 

'once again, this is the technique used by most translators of high-level pro- 
gramming languages. When faced with the declaration statement 

int Sales [8, 5] ,- 

declaring that the term Sales is to refer to a two-dimensional array of integer values 
with 8 rows and 5 columns, the translator arranges for 40 consecutive memory cells 
to be set aside. Later, if it encounters the assignment statement 

Sales [3, 4] <- 5 ; 

requesting that the value 5 be placed in the entry at the third row and fourth column 
of the array Sales, it builds the sequence of machine instructions required to place 
the value 5 in the memory cell whose address is x + 5(3 - 1 ) + (4 - 1), where x is the 
address of the first cell in the block associated with the array Sales. In this manner, 
the programmer is allowed to write the program as though the sales were actually 
stored in a two-dimensional array. 

Heterogeneous Arrays Now suppose we want to store a heterogeneous array 
called Employee consisting of the three components: Name of type character, Age of 
type integer, and SkillRating of type real. If the number of memory cells required 
by each component is fixed, then we can store the array in a block of contiguous cells. 
For example, suppose the component Name required at most 25 cells. Age required only 
one cell, and SkillRating required only one cell. Then, we could set aside a block 
of 27 contiguous cells, store the name in the first 25 cells, store the age in the 26th cell, 
and store the skill rating in the last cell (Figure 8.7a). 

With this arrangement, it would be easy to access the different components within 
the array. If the address of the first cell were*, then any reference to Enployee. Name 
(meaning the Name component within the array Employee) would translate to the 25 
cells starting at address x and a reference to Errployee .Age (the Age component within 
Employee) would translate to the cell at address x + 25. In particular, if a translator 
found a statement such as 

Employee. Age e- 22; 

in a high-level program, then it would merely build the machine language instructions 
required to place the value 22 in the memory cell whose address is x + 25. Or, if 
EmployeeOfMonth were defined to be a similar array stored at address y, then the 
statement 

EmployeeOfMonth <- Employee, - 

would translate to a sequence of instructions that copies the contents of the 27 cells 
beginning at address x to the 27 cells beginning at the address y. 

An alternative to storing a heterogeneous array in a block of contiguous memory 
cells is to store each component in a separate location and then link them together by 
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Figure 8.7 Storing the heterogeneous array Employee 
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means of pointers. More precisely, if the array contains three components, then we find 
a place in memory to store three pointers, each of which points to one of the compo- 
nents (Figure 8.7b). If these pointers are stored in a block starting at address x, then 
the first component can be found by following the pointer stored at location x, the sec- 
ond component can be found by following the pointer at location x + I, and so forth. 

This arrangement is especially useful in those cases in which the size of the 
array's components is dynamic. For instance, by using the pointer system the size of 
the first component can be increased merely by finding an area in memory to hold 
the larger component and then adjusting the appropriate pointer to point to the new 
location. But if the array were stored in a contiguous block, the entire array would have 
to be altered. 

Storing Lists 

Let us now consider techniques for storing a list of names in a computer's main 
memory. One strategy is to store the entire list in a single block of memory cells with 
consecutive addresses. Assuming that each name is no longer than eight letters, we 
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can divide the large block of cells into a collection of stibblocks, each containing 
eight cells. Into each sunblock we can store a name by recording its ASCII code 
using one cell per letter. If the name alone does not fill all the cells in the subblock 
allocated to it, we can merely fill the remaining cells with the ASCII code for a 
space. Using this system requires a block of 80 consecutive memory cells to store a 
list of 10 names. 

The storage system just described is summarized in Figure 8.8. The significant 
point is that the entire list is stored in one large block of memory, with successive 
entries following each other in contiguous memory cells. Such an organization is 
referred to as a contiguous list. 

A contiguous list is a convenient storage structure for implementing static lists, 
but it has disadvantages in the case of dynamic lists where the deletion and insertion 
of names can lead to a time-consuming shuffling of entries. In a worst case scenario, 
the addition of entries could create the need to move the entire list to a new location 
to obtain an available block of cells large enough for the expanded list. 

These problems can be simplified if we allow the individual entries in a list to be 
stored in different areas of memory rather than together in one large, contiguous 
block. To explain, let us reconsider our example of storing a list of names (where each 
name is no more than eight characters long). This time we store each name in a block 
of nine contiguous memory cells. The first eight of these cells are used to hold the 
name itself, and the last cell is used as a pointer to the next name in the list. Follow- 
ing this lead, the list can be scattered among several small nine-cell blocks linked 
together by pointers. Because of this linkage system, such an organization is called a 
linked list. 

To keep track of the beginning of a linked list, we set aside another pointer in 
which we save the address of the first entry. Since this pointer points to the beginning, 
or head, of the list, it is called the head pointer. 

To mark the end of a linked list, we use a NIL pointer (also known as a NULL 
pointer), which is merely a special bit pattern placed in the pointer cell of the last 
entry to indicate that no further entries are in the list. For example, if we agree never 
to store a list entry at address 0, the value zero will never appear as a legitimate 
pointer value and can therefore be used as the NIL pointer. 


Figure 8.8 Names stored in memory as a contiguous list 
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Figure 8.9 The structure of a linked list 
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The final linked list structure is represented by the diagram in Figure 8.9, in 
which we depict the scattered blocks of memory used for the list by individual rec- 
tangles. Each rectangle is labeled to indicate its composition. Each pointer is repre- 
sented by an arrow that leads from the pointer itself to the pointer's addressee. 
Traversing the list involves following the head pointer to find the first entry. From 
there, we follow the pointers stored with the entries to hop from one entry to the next 
until the NIL pointer is reached. 

To appreciate the advantages of a linked list over a contiguous one, consider the 
task of deleting an entry. In a contiguous list this would create a hole, meaning that 
those entries following the deleted one would have to be moved forward to keep the 
list contiguous. However, in the case of a linked list, an entry can be deleted by chang- 
ing a single pointer. This is done by changing the pointer that formerly pointed to the 
deleted entry so that it points to the entry following the deleted entry (Figure 8.10). 
From then on, when the list is traversed, the deleted entry is passed by because it no 
longer is part of the chain. 

Figure 8.1 0 Deleting an entry from a linked list 
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Inserting a new entry in a linked list is only a little more involved. We first find 
an unused block of memory cells large enough to hold the new entry and a pointer. 
Here we store the new entry and fill in the pointer with the address of the entry in 
the list that should follow the new entry. Finally, we change the pointer associated 
with the entry that should precede the new entry so that it points to the new entry 
(Figure 8.11). After we make this change, the new entry will be found in the proper 
place each time the list is traversed. 

Storing Stacks and Queues 

For storing stacks and queues, an organization similar to a contiguous list is often 
used. In the case of a stack, a block of memory, large enough to accommodate the stack 
at its maximum size, is reserved. (Determining the size of this block can often be a 
critical design decision. If too little room is reserved, the stack will ultimately exceed 
the allotted storage space; however, if too much room is reserved, memory space will 
be wasted.) One end of this block is designated as the stack’s base. It is here that the 
first entry to be pushed onto the stack is stored. Then each additional entry is placed 
next to its predecessor as the stack grows toward the other end of the reserved block. 

Observe that as entries are pushed and popped, the location of the top of the 
stack will move back and forth within the reserved block of memory cells. To keep 
track of this location, its address is stored in an additional memory cell known as the 
stack pointer. That is, the stack pointer is a pointer to the top of the stack. 

The complete system, as illustrated in Figure 8.12, works as follows: Tb push a new 
entry on the stack, we first adjust the stack pointer to point to the vacancy just beyond 
the top of the stack and then place the new entry at this location. Tb pop an entry from 
the stack, we read the data pointed to by the stack pointer and then adjust the stack 
pointer to point to the next entry down on the stack. 


Figure 8.11 Inserting an entry into a linked list 
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Figure 8.12 A stack in memory 



The traditional implementation of a queue is similar to that of a stack. Again we 
reserve a block of contiguous cells in main memory large enough to hold the queue 
at its projected maximum size. However, in the case of a queue we need to perform 
operations at both ends of the structure, so we set aside two memory cells to use as 
pointers instead of only one as we did for a stack. One of these pointers, called the 
head pointer, keeps track of the head of the queue; the other, called the tail pointer, 
keeps track of the tail. When the queue is empty, both of these pointers point to the 


A Problem with Pointers 

Just as the use of flowcharts led to tangled algorithm designs (Chapter 5), and 
the haphazard use of go to statements led to poorly designed programs (Chap- 
ter 6), undisciplined use of pointers has been found to produce needlessly com- 
plex and error-prone data structures. To bring order to this chaos, many 
programming languages restrict the flexibility of pointers. For example, Java 
does not allow pointers in their general form. Instead, it allows only a restricted 
form of pointers called references. One distinction is that a reference cannot be 
modified by an arithmetic operation. For example, if a Java programmer 
wanted to advance the reference Next to the next entry in a contiguous list, he 
or she would use a statement equivalent to 

redirect Next to the next list entry 

whereas a C programmer would use a statement equivalent to 

assign Next the value Next + 1 

Note that the Java statement better reflects the underlying goal. Moreover, to 
execute the Java statement, there must be another list entry, but if Next 
already pointed to the last entry in the list, the C statement would result in 
Next pointing to something outside the list-a common error for beginning, 
and even seasoned, C programmers. 
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Figure 8.13 A queue implementation with heod ond tail pointers. Mote howthe queue 
crawls through memory as entries are inserted and removed. 
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same location (Figure 8.13). Each time an entry is inserted into the queue, it is placed 
in the location pointed to by the tail pointer, and then the tail pointer is adjusted to 
point to the next unused location. In this manner, the tail pointer is always pointing 
to the first vacancy at the tail of the queue. Removing an entry from the queue involves 
extracting the entry pointed to by the head pointer and then adjusting the head pointer 
to point to the next entry in the queue. 

A problem with the storage system as described thus far is that, as entries are 
inserted and removed, the queue crawls through memory like a glacier (see again 
Figure 8.13). Thus we need a mechanism for containing the queue within its reserved 
block of memory. The solution is simple. We let the queue migrate through the block. 
Then, when the tail of the queue reaches the end of the block, we start inserting addi- 
tional entries back at the original end of the block, which by this time is vacant. Like- 
wise, when the last entry in the block finally becomes the head of the queue and this 
entry is removed, the head pointer is adjusted back to the beginning of the block 
where other entries are, by this time, waiting. In this manner, the queue chases itself 
around within the block rather than wandering off through memory. This technique 
results in an implementation that is called a circular queue. 
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Storing Binary Trees 

For the purpose of discussing tree storage techniques, we restrict our attention to 
binary trees, which we recall are trees in which each node has at most two children. 
Such trees normally are stored in memory using a linked structure similar to that of 
linked lists. However, rather than each entry consisting of two components (the data 
followed by a next-entry pointer), each entry (or node) of the binary tree contains 
three components: ( 1 ) the data, (2) a pointer to the node's first child, and (3) a pointer 
to the node's second child. Although there is no left or right inside a machine, it is help- 
ful to refer to the First pointer as the left child pointer and the other pointer as the 
right child pointer in reference to the way we would draw the tree on paper. Thus 
each node of the tree is represented by a short, contiguous block of memory cells 
with the format shown in Figure 8.14. 

Storing the tree in memory involves finding available blocks of memory cells to 
hold the nodes and linking these nodes according to the desired tree structure. Each 
pointer must be set to point to the left or right child of the pertinent node or assigned 
the NIL value if there are no more nodes in that direction of the tree. (This means that 
a terminal node is characterized by having both of its pointers assigned NIL . ) Finally, 
we set aside a special memory location, called a root pointer, where we store the 
address of the root node. It is this root pointer that provides initial access to the tree. 

An example of this linked storage system is presented in Figure 8.15, where a 
conceptual binary tree structure is exhibited along with a representation of how 
that tree might actually appear in a computer's memory. Note that the actual 
arrangement of the nodes within main memory might be quite different from the 
conceptual arrangement. However, by following the root pointer, one can find the 
root node and then trace any path down the tree by following the appropriate pointers 
from node to node. 

An alternative to storing a binary tree as a linked structure is to use a single, con- 
tiguous block of memory cells for the entire tree. Using this approach, we store the 
tree's root node in the first cell of the block. (For simplicity, we assume that each 
node of the tree requires only one memory cell.) Then we store the left child of the 
root in the second cell, store the right child of the root in the third cell, and in gen- 
eral, continue to store the left and right children of the node found in cell n in the cells 
2n and 2n + 1, respectively. Cells within the block that represent locations not used 
by the tree are marked with a unique bit pattern that indicates the absence of data. 
Using this technique, the same tree shown in Figure 8.15 would be stored as shown 
in Figure 8.16. Note that the system is essentially that of storing the nodes across 


Figure 8.14 The structure of a node in a binary tree 
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Figure 8.15 The conceptual and actual organization of a binary tree using a linked storage system 
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Actual storage organization 



Figure 8.16 A tree stored without pointers 
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successively lower levels of the tree as segments, one after the other. That is, the first 
entry in the block is the root node, followed by the roofs children, followed by the 
root's grandchildren, and so on. 

In contrast to the linked structure described earlier, this alternative storage sys- 
tem provides an efficient method for finding the parent or sibling of any node. The 
location of a node's parent can be found by dividing the node's position in the block 
by 2 while discarding any remainder (the parent of the node in position 7 would be 
the node in position 3). The location of a node's sibling can be found by adding 1 to 
the location of a node in an even-numbered position or subtracting 1 from the loca- 
tion of a node in an odd-numbered position. For example, the sibling of the node in 
position 4 is the node in position 5, while the sibling of the node in position 3 is the 
node in position 2. Moreover, this storage system makes efficient use of space when 
the binary tree is approximately balanced (in the sense that both subtrees below the 
root node have the same depth) and full (in the sense that it does not have long, thin 
branches). For trees without these characteristics, though, the system can become 
quite inefficient, as shown in Figure 8.17. 

Manipulating Data Structures 

We have seen that the way data structures are actually stored in a computer's mem- 
ory is not the same as the conceptual structure envisioned by the user. A two-dimen- 
sional homogeneous array is not actually stored as a two-dimensional rectangular 


Figure 8.17 A sparse, unbalanced tree shown in its conceptual form and os it would be stored without pointers 
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block, and a list or a tree might actually consist of small pieces scattered over a large 
area of memory. 

Hence, to allow the user to access the structure as an abstract tool, we must shield 
the user from the complexities of the actual storage system. This means that instruc- 
tions given by the user (and stated in terms of the abstract tool) must be converted 
into steps that are appropriate for the actual storage system. In the case of homoge- 
neous arrays, we have seen how this can be done by using an address polynomial to 
convert row and column indices into memory cell addresses. In particular, we have 
seen how the statement 

S a 1 e s [ 3 , 4] <- 5; 

written by a programmer who is thinking in terms of an abstract homogeneous array 
can be converted into steps that perform the correct modifications to main memory. 
Likewise, we have seen how statements such as 

Employee. Age 4-22; 

referring to an abstract heterogeneous array can be translated into appropriate actions 
depending on how the array is actually stored. 

In the case of lists, stacks, queues, and trees, instructions stated in terms of the 
abstract structure are usually converted into the appropriate actions by means of pro- 
cedures that perform the required task while shielding the user from the details of 
the underlying storage system. For example, if the procedure insert were pro- 
vided for inserting new entries into a linked list, then J. W. Brown could be inserted 
in the list of students enrolled in Physics 208 merely by executing a procedure call 
such as 


insert(" Brown, J.W.", Physics208) 

Note that the procedure call is stated entirely in terms of the abstract structure-the 
manner in which the list is actually implemented is hidden. 

As a more detailed example, Figure 8.18 presents a procedure named printList 
for printing a linked list of names. This procedure assumes that the first entry of the 
list is pointed to by a pointer called the head pointer and that each entry in the list con- 
sists of two pieces: a name and a pointer to the next entry. Once this procedure has 


Figure 8.18 A procedure for printing a linked list 


procedure PrintList (List) 

CurrentPointer <- head pointer of List, 
while (CurrentPointer is not NIL) do 

(Print the name in the entry pointed to by CurrentPointer; 
Observe the value in the pointer cell of the List entry 
pointed to by CurrentPointer, and reassign CurrentPointer 
to be that value.) 
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been developed, it can be used to print a linked list as an abstract tool without being 
concerned for the steps actually required to print the list. For example, to obtain a 
printed class list for Economics 301, a user need only perform the procedure call 

printList(Economics3 0 lClassList) 

to obtain the desired results. Moreover, if we should later decide to change the man- 
ner in which the list is actually stored, then only the internal actions of the procedure 
printList must be changed-the user would continue to request the printing of the 
list with the same procedure call as before. 


1 . Show how the array below would be arranged in main memory when stored 
in row major order. 
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2. Give a formula for finding the entry in the ith row and ;th column of a two- 
dimensional array if it is stored in column major order rather than row major 
order. 

3. In the C, C++, Java, and C# programrriii^llaT^Ufi^e^,iiiiiiG£SsaIkaiiia^s k <sttart at 
0 rather than at 1. Thus the entry in the first row, fourth column of an array 
named Array is referenced by Array [ 0 ] [3]. In this case, what address 
polynomial is used by the translator to convert references of the form 
Array [ i ] [ j ] into memory addresses? 

4. What condition indicates thaffl. a linked list is empty? 

5 Modify the procedure in FS%W»e SG> tteat ttttStKMpfe printing once a particular 
name has been printed. 

6 . Based on the technique of this section for implementing a stack in a contigu- 
ous block of cells, what condition indicates that the stack is empty? 

7 Describe how a stack can be implemented in a high-level language in terms of 
a one-dimensional array. 

8. When a queue is implentffctflitKeall iirft aiimtJlHr tfaslhion as described in this sec- 
tion, what is the relationship between the head and tail pointers when the 
queue is empty? What about when the queue is full? How can one detect 
whether a queue is full or empty? 
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9. Draw a diagram representing how the tree below appears in memory when 
stored using the left and right child pointers, as described in this section. 
Then, draw another diagram showing how the tree would appear in contigu- 
ous storage using the alternative storage system described in this section. 
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Let us consider the task of storing a list of names in alphabetical order. We assume that 
the operations to be performed on this list are the following: 

search for the presence of an entry, 
print the list in alphabetical order, and 
insert a new entry 

Our goal is to develop a storage system along with a collection of procedures to 
perform these operations-thus producing a complete abstract tool. 

We begin by considering options for storing the list. If the list were stored accord- 
ing to the linked list model, we would need to search the list in a sequential fashion, 
a process that, as we discussed in Chapter 5, could be very inefficient if the list becomes 
long. We will therefore seek an implementation that allows us to use the binary search 
algorithm (Section 5.5} for our search procedure. To apply this algorithm, our storage 
system must allow us to find the middle entry of successively smaller portions of the 
list. Our solution is to store the list as a binary tree. We make the middle list entry the 
root node. Then we make the middle of the remaining first half of the list the root's left 
child, and we make the middle of the remaining second half the root's right child. The 
middle entries of each remaining fourth of the list become the children of the root's 
children and so forth. For example, the tree in Figure 8.19 represents the list of letters 
A, B, C, D, E, F, G, H, I, J, K, L, and M. (We consider the larger of the middle two entries 
as the middle when the part of the list in question contains an even number of entries.) 

F i g u r e 8 . 1 9 The letters A through M arranged in an ordered tree 
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To search the list stored in this manner, we compare the target value to the root 
node. If the two are equal, our search has succeeded. If they are not equal, we move to 
the left or right child of the root, depending on whether the target is less than or greater 
than the root, respectively. There we find the middle of the portion of the list that is nec- 
essary to continue the search. This process of comparing and moving to a child continues 
until we find the target value (meaning that our search was successful) or we reach a 
NIL pointer without finding the target value (meaning that our search was a failure). 

Figure 8.20 shows how this search process can be expressed in the case of a linked 
tree structure. Note that this procedure is merely a refinement of the procedure in Fig- 
ure 5.14, which is our original statement of the binary search. The distinction is largely 
cosmetic. Instead of stating the algorithm in terms of searching successively smaller 
segments of the list, we now state the algorithm in terms of searching successively 
smaller subtrees (Figure 8.21). 

Having stored our "list" as a binary tree, you might think that the process of print- 
ing the list in alphabetical order would now be difficult. However, to print the list in 
alphabetical order, we merely need to print the left subtree in alphabetical order, print 
the root node, and then print the right subtree in alphabetical order (Figure 8.22). 
After all, the left subtree contains all the elements that are less than the root node, 
while the right subtree contains all the elements that are greater than the root. A 
sketch of our logic so far looks like this: 

if (tree not empty) 

then {print the left subtree in alphabetical order; 
print the root node; 

print the right subtree in alphabetical order) 


Figure 8.20 The binary search as it would appear if the list were implemented as a linked binary tree 


procedure Search(Tree, TargetValue) 

if (root pointer of Tree = NIL) 
then 

(declare the search a failure) 
else 

(execute the block of instructions below that is 
associated with the appropriate case) 
case 1: TargetValue = value of root node 
(Report that the search succeeded) 
case 2: TargetValue < value of root node 
(Apply the procedure Search to see if 
TargetValue is in the subtree identified 
by the root's left child pointer and 
report the result of that search) 
case 3: TargetValue > value of root node 
(Apply the procedure Search to see if 
TargetValue is in the subtree identified 
by the root's right child pointer and 
report the result of that search) 

) e n d if 
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Figure 8.21 The successively smaller trees considered by the procedure in Figure 8.20 
when searching for the letter J 



This outline involves the tasks of printing the left subtree and the right subtree 
in alphabetical order, both of which are essentially smaller versions of our original task. 
That is, solving the problem of printing a tree involves the smaller task of printing sub- 
trees, which suggests a recursive approach to our tree printing problem. 


Figure 8.22 Printing a search tree in alphabetical order 
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Garbage Collection 

As dynamic data structures grow and shrink, storage space is used and released,. 
The process of reclaiming unused storage space for future use is known as 
garbage collection. Garbage collection is required in numerous settings. The 
memory manager within an operating system must perform garbage collection 
as it allocates and retrieves memory space. The fde manager performs garbage 
collection as files are stored in and deleted from the machine’s mass storage. 
Moreover, any process running under the control of the dispatcher might need 
to perform garbage collection within its own allotted memory space. 

Garbage collection involves some subtle problems. In the case oflinked 
structures, each time a pointer to a data item is changed, the garbage collector 
must decide whether to reclaim the storage space to which the pointer origi- 
nally pointed. The problem becomes especially complex in intertwined data 
structures involving multiple paths of pointers. Inaccurate garbage collection 
routines can lead to loss of data or to inefficient use of storage space. For exam- 
ple, if garbage collection fails to reclaim storage space, the available space will 
slowly dwindle away, a phenomenon known as a memory leak. 


Following this lead, we can expand our initial idea into a complete pseudocode 
procedure for printing our tree as shown in Figure 8.23. We have assigned the routine 
the name PrintTree and then requested the services ofPrintTree for printing the left and 
right subtrees. Note that the termination condition of the recursive process (reaching 
an empty subtree) is guaranteed to be reached, because each successive activation of 
the routine operates on a smaller tree than the one causing the activation. 

The task of inserting a new entry in the tree is also easier than it might appear 
at first. Your intuition might lead you to believe that insertions might require cutting 
the tree open to allow room for new entries, but actually the node being added can 
always be attached as a new leaf, regardless of the value involved. To find the proper 
place for a new entry, we move down the tree along the path that we would follow if 
we were searching for that entry. Since the entry is not in the tree, our search will lead 


Figure 8.23 A procedure for printing the data in a binary free 


procedure PrintTree (Tree) 
if (T ree is n ot e m p ty ) 

rhen (Apply the procedure PrintTree to the tree that 
appears as the left branch in Tree; 

Print the root node of Tree; 

Apply the procedure PrintTree to the tree that 
appears as the right branch in Tree) 
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to a NIL pointer. At this point we will have found the proper location for the new 
node (Figure 8.24), Indeed, this is the location to which a search for the new entry 
would lead. 

A procedure expressing this process in the case of a linked tree structure is shown 
in Figure 8.25. It searches the tree for the value being inserted (called NewValue) 
and then places a new leaf node containing NewValue at the proper location. Note that 
if the entry being inserted is actually found in the tree during the search, no inser- 
tion is made. 

We conclude that a software package consisting of a linked binary tree structure 
together with our procedures for searching, printing, and inserting provides a com- 
plete package that could be used as an abstract tool by our hypothetical application. 
Indeed, when properly implemented, this package could be used without concern 
for the actual underlying storage structure. By using the procedures in the package, 
the user could envision a list of names stored in alphabetical order, whereas the real- 
ity would be that the "list" entries are actually scattered among blocks of memory 
cells that are linked as a binary tree. 


Figure 8.24 Inserting the entry M into the list B, E, G, H, J, K, N, P stored as a tree 


a. Search for the new entry until its absence is detected 
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Figure 8.25 A procedure for inserting a new entry in o list stored as a binary tree 


procedure InsertfTree, NewValue) 

if (root pointer of Tree = NIL) 

(set the root pointer to point to a new leaf 
containing NewValue) 

else (execute the block of instructions below that is 
associated with the appropriate case) 
case 1: NewValue = value of root node 
(Do nothing) 

case 2: NewValue < value of root node 

(if (left child pointer of root node - NIL) 

then (set that pointer to point to a new 
leaf node containing NewValue) 
else (apply the procedure Insert to insert 

NewValue into the subtree identified 
by the left child pointer) 
case 3: NewValue > value of root node 

(if (right child pointer of root node = NIL) 

then (set that pointer to point to a new 
leaf node containing NewValue) 
else (apply the procedure insert to insert 
NewValue into the subtree identified 
by the right child pointer) 

) end if 


1. Draw a binary tree that you could use to store the list R, S, T, U, V, W, X, Y, 

and Z for future searching. & 

2. indicate the path traversed by the binary search algorithm in Figure 8.20 
when applied to the tree in Figure 8.19 in searching for the entry J. What 
about the entry P? 

3. Draw a diagram representing the status of activations of the recursive tree- 
printing algorithm in Figure 8.23 at the time node K is printed within the 
ordered tree in Figure 8.19. 

4. Describe how a tree structure in which each node has as many as 26 children 
could be used to encode the correct spelling of words in the English language. 

8.4 Customized Data Types 

In Chapter 6 we introduced the concept of a data type and discussed such elementary 
types as integer, real, character, and Boolean. These data types are provided in most 
programming languages as primitive data types. In this section we consider ways in 
which A programmer can define his or her own data types to fit more closely the 
needs of a particular application. 


Questions 

Exercises 
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User-Defined Data Types 

Expressing an algorithm is often easier if data types other than those provided as 
primitives in the programming language are available. For this reason, many modern 
programming languages allow programmers to define additional data types, using the 
primitive types as building blocks. The most elementary examples of such "home- 
made" data types are known as user-defined data types, which are essentially con- 
glomerates of primitive types collected under a single name. 

To explain, suppose we wanted to develop a program involving numerous vari- 
ables, each with the same heterogeneous array structure consisting of a name, age, 
and skill rating. One approach would be to define each variable separately as a het- 
erogeneous array (Section 6.2). A better approach, however, would be to define the het- 
erogeneous structure to be a new (user-defined) data type and then to use that new- 
type as though it were a primitive. 

lb implement this idea, we could adopt the pseudocode statement of the form 

define type EmpioyeeType to be 
{char Name[25]; 
i n t Age; 
real SkillRating; 

} 

to define a new type, called EmpioyeeType, that consists of the heterogeneous 
structure containing components called Name (of type character). Age (of type 
integer), and SkillRating (of type real). This new data type could then be used to 
declare variables in the same way as a primitive data type. That is, in the same way 
that most programming languages allow the variable x to be declared as an integer 
using the statement 

int x; 

the variable Em ploy eel could be declared to be of the type EmpioyeeType with the 
statement 

EmpioyeeType Employee 1 ; 

Then, later in the program, the variable Em ploy eel would refer to an entire block of 
memory cells containing the name, age, and skill rating of an employee. Individual 
items within the block could be referenced by expressions such as Employeel .Name 
and Employeel .Age. Thus, a statement such as 

Employeel. Age <- 26; 

might be used to assign the value 26 to the Age component within the block known 
as Employeel. Moreover, the statement 

EmpioyeeType DistManager, SalesRepi, SalesRep2; 

could be used to declare the three variables DistManager, SalesRepi, and SalesRep2 to 
be of type EmpioyeeType just as a statement of the form 


real Sleeve, Waist, Neck; 
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is normally used to declare the variables Sleeve, Waist, and Neck to be of the primitive 
type real. 

It is important to distinguish between a user-defined data type and an actual item 
of that type. The latter is referred to as an instance of the type. A user-defined data 
type is essentially a template that is used in constructing instances of the type. It 
describes the properties that all instances of that type have but does not itself con- 
stitute an occurrence of that type (just as a cookie-cutter is a template from which 
cookies are made but is not itself a cookie). In the preceding example, the user-defined 
data type EmpioyeeType was used to construct three instances of that type, known as 
DistManager, SalesRepl, and SalesRep2. 


Abstract Data Types 

Although the concept of a user-defined data type is advantageous, it falls short of 
allowing the creation of new data types in the full sense. A complete data type con- 
sists of two parts: (1) a predetermined storage system (such as a two's complement 
system in the case of the type integer and a floating-point system in the case of type 
real) and (2) a collection of predefined operations (such as addition and subtraction). 
In particular, the primitive data types in a programming language are associated with 
primitive operations. If a programmer declares a variable to be of a primitive type, 
the programmer can begin applying primitive operations to that variable without 
further definitions. 

Traditional user-defined data types, however, merely allow programmers to define 
new storage systems. They do not also provide operations to be performed on data with 
these structures. To clarify, suppose we wanted to create and use several stacks of 
integer values within a program. Our approach might be to implement each stack 
as a homogeneous array of 20 integer values. The bottom entry in the stack would 
be placed (pushed) into the first array position, and additional stack entries would be 
placed (pushed) into successively higher entries in the array (see Question/Exercise 
7 in Section 8.2). An additional integer variable would be used as the stack pointer. It 
would hold the index of the array entry into which the next stack entry should be 
pushed. Thus each stack would consist of a homogeneous array containing the stack 
itself and an integer playing the role of the stack pointer. 

To implement this plan, we could first establish a user-defined type called Stack- 
Type with a statement of the form 

define type StackType to be 

{ int StackEntries [20] ; 
intStackPointer = 0; 

} 

(Note that, following the lead of languages such as C, C + + , Ctf and Java, we arc 
assuming that the indices for the array StackEntries range from 0 to 19, so we have 
initialized StackPointer to the value 0.) Having made this declaration, we could then 
declare stacks called StackOne, StackTwo, and StackThree via the statement 

StackType StackOne, StackTwo, StackThree; 
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At this point, each of the variables StackOne, StackTwo, and StackThree would refer- 
ence a unique block of memory cells used to implement an individual stack. 

But what if we now want to push the value 25 onto StackOne? We would like to 
avoid the details of the array structure underlying the Stack's implementation and 
merely use the stack as an abstract tool-perhaps by using a procedure call similar to 

push(25, StackOne) 

But such a statement would not be available unless we also defined an appropriate pro- 
cedure named push. Other operations we would like to perform on variables of type 
StackType would include popping entries off the stack, checking to see if the stack is 
empty, and checking to see if the stack is full-all of which would require definitions 
of additional procedures. In short, our definition of the data type StackType has not 
included all the properties we would like to have associated with the type. 

We could solve this problem by expanding our define type statement to include 
procedures as well as data descriptions. For example, we could write 

define type StackType to be 
{ int StackEntries [20] ; 
int StackPointer = 0; 
procedure push(vaiue) 

{ StackEntriesEStackPointer] <- value; 

StackPointer <- StackPointer + 1 ; 

} 

procedure pop . . . 


} 

which is intended to mean that the type StackType is associated with variables 
called StackEntries and StackPointer and procedures called push, and pop. (For the 
sake of simplicity we have included a very naive version of the procedure push. In 
reality the procedure should ensure that the stack is not full before trying to insert 
an additional entry.) 

With this extended definition of the type StackType, we could declare StackOne, 
StackTwo, and StackThree to be stacks with the statement 

StackType StackOne, StackTwo, StackThree; 

Then we could push entries onto these stacks with statements such as 

StackOne. push (25); 

which means to execute the push procedure associated with StackOne using the value 
25 as the actual parameter. 

User-defined data types that include definitions of operations are called abstract 
data types. Thus, as opposed to the more elementary user-defined data types, abstract 
data types are complete data types, and their appearance in such languages as Ada in 
the 1980s represented a significant step forward in programming language design. 
Tbday, object-oriented languages provide for extended versions of abstract data types 
called classes, as we will see in the next section. 
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l. What is the difference between a data type and an instance of that type? 

2 What is the difference between a user-defined data type and an abstract data 
type? 

3. Describe an abstract data type for implementing a list. 

4. Describe an abstract data type for implementing checking accounts. 


Questions 
& Exercises 


S.5 Classes and Objects 

As we learned in Chapter 6, the object-oriented paradigm leads to systems composed 
of units called objects that interact with each other to accomplish tasks. Each object 
is an entity that responds to messages received from other objects. Objects are 
described by templates known as classes. 

In many respects, these classes are actually descriptions of abstract data types 
(whose instances are called objects). In fact, the statements used to define classes in 
popular object-oriented programming languages are strikingly similar to the define 
type statement introduced in the previous section. For example. Figure 8.26 shows how 
a class known as StackOf Integer s can be defined in the languages Java and C#. 
(The equivalent class definition in C ++ has the same structure but slightly different 
syntax.) Note the similarity between this class and the define type statement used in 
the previous section to describe the abstract data type StackType. It describes the 
class/type as containing an array of integers called S tackEntrie s , an integer used 
to identify the top of the stack within the array called S tackPointer , and proce- 
dures for manipulating the stack. 

Figure8.26 A stack of integers implemented in Java and C# 


class StackOf Integers 

{private i n t [.] StackEntries = new i n t [ 2 0 ] ; 
private int StackPointer = 0; 


public void push(int NewEntry) 

(if (StackPointer < 20) 

StackEntries[StackPoincer + + ] = NewEntry; 

} 

public int pop() 

(if (StackPointer > 0) return StackEntries [--StackPoi nter] 
else return 0; 


} 
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The Standard Template Library 

The data structures discussed in this chapter have become standard programming, 
structures- so standard, in fact, that many programming environments treat 
them very much like primitives. One example is found in the C ++ programming 
environment, which is enhanced by the Standard Template Library (STL). The 
STL contains a collection of predefined classes that describe popular data struc- 
tures. Consequently, by incorporating the STL into a C ++ program, the program- 
mer is relieved from the task of describing these structures in detail. Instead, he 
or she needs merely to declare identifiers to be of these types in the same man- 
ner that we declared StackOne to be of type StackOf Integer s in Section 8.5. 


Using this class as a template, an object named StackOne can be created in a Java 
or C# program by the statement 

StackOflnteger s StackOne = new S t a c k O f I n t e g e r s ( ) ; 
or in a C ++ program by the statement 

StackOf I n t e g e r s StackOne) ); 

Later in the programs, the value 106 can be pushed onto StackOne using the state- 
ment 


StackOne. push(106),- 

or the top entry from StackOne can be retrieved and placed in the variable OldValue 
using the statement 

OldValue = StackOne. pop 0; 

These features are essentially the same as those associated with abstract data 
types. There are, however, distinctions between classes and abstract data types. The 
former is an extension of the latter. For instance, as explained in the optional Section 
6.5, object-oriented languages allow classes to inherit properties from other classes and 
to contain special methods called constructors that customize individual objects when 
they are created. Moreover, classes are normally associated with varying degrees of 
encapsulation (Section 6.5), allowing the internal properties of their instances to be 
protected from misguided shortcuts. And, finally, a class might be used as a means 
of grouping related procedures, and therefore a class might consist only of procedure 
definitions. In this sense, we could call a class an abstract type rather than an abstract 
data type. 

We conclude that the concepts of classes and objects represent another step in the 
evolution of techniques for representing data abstractions in programs. It is, in fact, 
the ability to define and use abstractions in a convenient manner that has led to the 
popularity of the object-oriented programming paradigm. 
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1 . In what ways are albstttact data types and classes Similar? In what ways are 

they different? 

2 What is the difference between a class and an object? 

3. Describe a class that would be used as a template for constructing objects of 
type queue-of-integers. 


8.6 Pointers in Machine Language 

In this chapter we have introduced pointers and have shown how they are used in con- 
structing data structures. In this section we consider how pointers are handled in 
machine language. 

Suppose that we want to write a program in the machine language described in 
Appendix C to pop an entry off the stack as described in Figure 8.12 and place that 
entry in a general-purpose register. In other words, we want to load a register with the 
contents of the memory cell that contains the entry on top of the stack. Our machine 
language provides two instructions for loading registers: one with op-code 2, the other 
with op-code 1 . Recall that in the case of op-code 2, the operand field contains the data 
to be loaded, and in the case of op-code 1, the operand field contains the address of 
the data to be loaded. 

We do not know what the contents will be, so we cannot use op-code 2 to obtain 
our goal. Moreover, we cannot use op-code 1, because we do not know what the 
address will be. After all, the address of the top of the stack will vary as the program 
is executed. However, we do know the address of the stack pointer. That is, we know 
the location of the address of the data we want to load. What we need, then, is a third 
op-code for loading a register, in which the operand contains the address of a pointer 
to the data to be loaded. 

To accomplish this goal we could extend the language in Appendix C to include 
an op-code D. An instruction with this op-code could have the form DRXY, which 
would mean to load register R with the contents of the memory cell whose address is 
found at address XY (Figure 8.27). Thus if the stack pointer is in the memory cell at 
address AA, then the instruction D5AA would cause the data at the top of the stack 
to be loaded into register 5. 

This instruction, however, does not complete the pop operation. We must also 
subtract one from the stack pointer so that it points to the new top of the stack. This 
means that, following the load instruction, our machine language program would 
have to load the stack pointer into a register, subtract one from it, and store the result 
back in memory. 

By using one of the registers as the stack pointer instead of a memory cell, we 
could reduce this movement of the stack pointer back and forth between registers 
and memory. But this would mean that we must redesign the load instruction so that 
it expects the pointer to be in a register rather than in main memory. Thus, instead 
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Figure 8.27 Our first attempt at expanding the machine language in Appendix C 
to take advantage of pointers 


Address in 
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of the earlier approach, we might define an instruction with op-code D to have the 
form DROS, which would mean to load register R with the contents of the memory cell 
pointed to by register S (Figure 8.28). Then, a complete pop operation could be per- 
formed by following this instruction with an instruction (or instructions) to subtract 
one from the value stored in register S. 

Note that a similar instruction is needed to implement a push operation. We might 
therefore extend the language described in Appendix C further by introducing the 


Figure 6.28 Loading a register from a memory cell that is located by means 
of a pointer stored in a register 
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op-code E so that an instruction of the form EROS would mean to store the contents 
of register R in the memory cell pointed toby register S. Again, to complete the push 
operation, this instruction would be followed by an instruction (or instructions) to 
add one to the value in register S. 

These new op-codes D and E that we have proposed not only demonstrate how 
machine languages are designed to manipulate pointers, they also demonstrate an 
addressing technique that was not present in the original machine language. As 
presented in Appendix C, the machine language uses two means of identifying the 
data involved in an instruction. The first of these is demonstrated by an instruction 
whose op-code is 2. Here, the operand field contains the data involved explicitly. 
This is called immediate addressing. The second means of identifying data is 
demonstrated by instructions with op-codes 1 and 3. Here the operand fields con- 
tain the address of the data involved. This is called direct addressing. However, 
our proposed new op-codes D and E demonstrate yet another form of identifying 
data. The operand fields of these instructions contain the address of the address of 
the data. This is called indirect addressing. All three are common in today's 
machine languages. 


1 . Suppose the machine language described in Appendix C has been extended as 
suggested at the end of this section. Moreover, suppose register 8 contains the 
pattern DB, the memory cell at address DB contains the pattern CA, and the 
cell at address CA contains the pattern A5. What bit pattern will be in register 
5 immediately after executing each of the following instructions? 
a. 25A5 b. 15CA c. D508 

2 Using the extensions described at the end of this section, write a complete 
machine language routine to perform a pop operation. Assume that the stack 
is implemented as shown in Figure 8.12, the stack pointer is in register F, and 
the top of the stack is to be popped into register 5. 

3. Using the extensions described at the end of this section, write a program to 
copy the contents of five contiguous memory cells starting at address AO to 
the five cells starting at address BO. Assume your program starts at address 00. 

4 in the chapter, we introduced a machine instruction of the form DROS. 

Suppose we extended this form to DRXS, meaning "Load register R with the 
data pointed to by the value in register S plus the value X." Thus the pointer 
to the data is obtained by retrieving the value in register S and then incre- 
menting that value by X. The value in register S is not altered. (If register F 
contained 04, then the instruction DE2F would load register E with the con- 
tents of the memory cell at address 06. The value of register F would remain 
04.) What advantages would this instruction have? What about an instruction 
of the form DRTS -meaning "Load register R with the data pointed to by the 
value in register S incremented by the value in register T"? 
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(Asterisked problems are associated with optional 

1 . Draw pictures showing how the array below 
appears in a machine's memory when stored 
in row major order and in column major order: 


A 

B 

C 

D 

E 

F 

G 

H 

1 

J 

K 

L 


2. Suppose a homogeneous array with six rows 
and eight columns is stored in row major 
order starting at address 20 (base ten). If each 
entry in the array requires only one memory 
cell, what is the address of the entry in the 
third row and fourth column? What if each 
entry requires two memory cells? 

3. Rework Problem 2 assuming column major 
order rather than row major order. 

4 What complications are imposed if one tries to 
implement a dynamic list using a traditional 
one-dimensional homogeneous array? 

5. Describe a method for storing three-dimen- 
sional homogeneous arrays. What address 
polynomial would be used to locate the entry 
in the ith plane, ;'th row, and the kth column? 

6. Suppose the list of letters A, B, C, E, F, and G 
is stored in a contiguous block of memory 
cells. What activities are required to insert the 
letter D in the list, assuming that the list's 
alphabetical order is to be maintained? 

7. The table below represents the contents of 
some cells in a computer's main memory 
along with the address of each cell repre- 
sented. Note that some of the cells contain let- 
ters of the alphabet, and each such cell is 
followed by an empty cell. Place addresses in 
these empty cells so that each cell containing 
a letter together with the following cell form 
an entry in a linked list in which the letters 


appear in alphabetical order. (Use zero for the 
NIL pointer.) What address should the head 
pointer contain? 


Address 

Contents 

11 

C 

12 


13 

G 

14 


15 

E 

16 


17 

B 

18 


19 

U 

20 


21 

F 

22 


The following table represents a portion of a 

linked list in 

a computer's main memory. 

Each entry in 

the list consists of two cells: The 

first contains 

a letter of the alphabet; the sec- 

ond contains 

a pointer to the next list entry. 

Alter the pointers so that the letter N is no 
longer in the list. Then replace the letter N 
with the letter G and alter the pointers so that 
the new letter appears in the list in its proper 
place in alphabetical order. 

Address 

Contents 

30 

J 

31 

38 

32 

B 

33 

30 

34 

X 

35 

46 

36 

N 

37 

40 

38 

K 

39 

36 

40 

P 

41 

34 
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9. The table below represents a linked list using 
the same format as in the preceding problems. 
If the head pointer contains the value 44, what 
name is represented by the list? Change the 
pointers so that the list contains the name 
Jean. 


Address 

Contents 

40 

N 

41 

46 

42 

I 

43 

40 

44 

J 

45 

50 

46 

E 

47 

00 

48 

M 

49 

42 

50 

A 

51 

40 

1 0. Which of the following routines correctly 


inserts NewEntry immediately after the entry 
called Pr eviou s Entry in a linked list? What 
is wrong with the other routine? 

Routine 1: 

1. Copy the value in the pointer 
field of Pre viousEntry into 
the pointer field of NewEntry. 

2. Change the value in the 
pointer field of Pre viousEntry 
to the address of NewEntry. 

Routine 2: 

1. Change the value in the 
pointer field of Pre viousEntry 
to the address of NewEntry. 

2. Copy the value in the pointer 
field of Pre viousEntry into 
the pointer field of NewEntry. 

1 1 . Design a procedure for concatenating two 
linked lists (that is, placing one before the 
other to form a single list). 

1 2. Design a procedure for combining two sorted 
contiguous lists into a single sorted contiguous 
list. What if the lists are linked? 


1 3, Design a procedure for reversing the order of a 
linked list. 

1 4. a. Design an algorithm for printing a linked 

list in reverse order using a stack as an aux- 
iliary storage structure, 
b. Design a recursive procedure to perform 
this same task without making explicit 
use of a stack. In what form is a stack 
still involved in your recursive solution? 

15. Sometimes a single linked list is given two 
different orders by attaching two pointers 
to each entry rather than one. Fill in the 
table below so that by following the first 
pointer after each letter one finds the name 
Carol, but by following the second pointer 
after each letter one finds the letters in 
alphabetical order. What values belong in 
the head pointer of each of the two lists 
represented? 

Address 
60 
SI 
62 

63 

64 

65 

66 

67 

68 

69 

70 

71 

72 

73 

74 

16. The table below represents a stack stored 
in a contiguous block of memory cells, 
as discussed in the text. If the base of the 
stack is at address 10 and the stack pointer 
contains the value 12, what value is re- 
trieved by a pop instruction? What value 
is in the stack pointer after the pop 
operation? 


Contents 

O 


C 


A 


L 


R 
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Address 

10 

11 

12 

13 

14 


Contents 

F 

C 

A 

B 

E 


17. Draw a table showing the final contents of the 
memory cells if the instruction in Problem 16 
had been to push the letter D on the stack 
rather than to pop a letter. What would the 
value in the stack pointer be after the push 
instruction? 

1 8. Design a procedure to remove the bottom entry 
from a stack so that the rest of the stack is 
retained. You should access the stack using only 
push and pop operations. What auxiliary storage 
structure should be used to solve this problem? 

1 9. Design a procedure to compare the contents of 
two stacks. 


20. Suppose you were given two stacks. If you 
were only allowed to move entries one at a 
time from one stack to another, what 
rearrangements of the original data would be 
possible? What arrangements would be possi- 
ble if you were given three stacks? 

2 1 . Suppose you were given three stacks and you 
were only allowed to move entries one at a 
time from one stack to another. Design an 
algorithm for reversing two adjacent entries 
on one of the stacks. 


22. Suppose we want to create a stack of names 
that vary in length. Why is it advantageous to 
store the names in separate areas of memory 
and then build the stack out of pointers to 
these names rather than allowing the stack to 
contain the names themselves? 


23. Does a queue crawl through memory in the 
direction of its head or its tail? 


24. Suppose you wanted to implement a "queue" 
in which new entries had priorities associated 
with them. Thus a new entry should be placed 
in front of those entries with lower priorities. 


Describe a storage system for implementing 
such a "queue" andjustify your decisions. 


25. Suppose the entries in a queue require one 
memory cell each, the head pointer contains 
the value 11, and the tail pointer contains the 
value 17. What are the values of these pointers 
after one entry is inserted and two are 
removed? 


26. a. Suppose a queue implemented in a circular 
fashion is in the state shown in the diagram 
below. Draw a diagram showing the struc- 
ture after the letters G and R are inserted, 
three letters are removed, and the letters D 
and P are inserted. 



b. What error occurs in part (a) if the letters 
G, R, D, and P are inserted before any let- 
ters are removed? 


27. Describe how an array could be used to imple- 
ment a queue in a program written in a high- 
level language. 

26. Suppose you were given two queues and you 
were only allowed to move one entry at a time 
from the head of a queue to the tail of either. 
Design an algorithm for reversing two adja- 
cent entries in one of the queues. 


29. The table below represents a tree stored in a 
machine's memory. Each node of the tree con- 
sists of three cells. The first cell contains the 
data (a letter), the second contains a pointer to 
the node's left child, and the third contains a 
pointer to the node's right child. A value of 0 
represents a NIL pointer. If the value of the 
root pointer is 55, draw a picture of the tree. 

Address Contents 

40 G 

41 0 

42 0 

43 X 
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44 

0 

G 

45 

0 

X \ 

46 

J 

C K 

47 

49 

\ A 

48 

0 

E H P 

49 

M 


50 

0 

31 . Design a nonrecursive algorithm to replace 

51 

0 

the recursive one represented in Figure 8.20. 

52 

F 

32. Design a nonrecursive algorithm to replace 

53 

43 

the recursive one represented in Figure 8.23. 

54 

40 

Use a stack to control any backtracking that 

55 

w 

might be necessary. (The term backtracking 

56 

46 

refers to the process of backing out of a sys- 

57 

52 

tem in the opposite order from which the sys 


3 0 . The table below represents the contents of a 
block of cells in a computer's main memory. 
Note that some of the cells contain letters of 
the alphabet, and each of those cells is fol- 
lowed by two blank cells. Fill in the blank cells 
so that the memory block represents the tree 
that follows. Use the first cell following a letter 
as the pointer to that node's left child and the 
next cell as the pointer to the right child. Use 
0 for NIL pointers. What value should be in 
the root pointer? 


Address 

30 

31 

32 

33 

34 

35 

36 

37 

38 

39 

40 

41 

42 

43 

44 

45 

46 

47 


Contents 

C 


33 . 


34 . 


35 . 


tern was entered. A classic example is the 
process of retracing steps to find one's way out 
of a forest. In this problem, backtracking 
involves finding one's way back up the tree in 
order to pursue another branch.) 

Apply the recursive tree-printing algorithm of 
Figure 8.23 to the tree represented in Problem 
29. Draw a diagram representing the nested 
activations of the algorithm (and the current 
position in each) at the time node X is printed. 

While keeping the root node the same and 
without changing the physical location of the 
data elements, change the pointers in the tree 
of Problem 29 so the tree-printing algorithm of 
Figure 8.23 prints the nodes alphabetically. 

Draw a diagram showing how the binary tree 
below appears in memory when stored with- 
out pointers using a block of contiguous mem- 
ory cells as described in Section 8.2. 


A 


w 


3 6 . Suppose the contiguous cells representing 
a binary tree as described in Section 8.2 
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contained the values A, B, C, D, E, F, and F, 
respectively. Draw a picture of the tree. 

37. Give an example in which you might want to 
implement a list (the conceptual structure) as 
a tree (the actual underlying structure). Give 
an example in which you might want to imple- 
ment a tree (the conceptual structure) as a list 
(the actual underlying structure). 

38. The linked tree structures discussed in the 
text contained pointers that allowed one to 
move down the tree from parents to children. 
Describe a pointer system that would allow 
movement up the tree from children to par- 
ents. What about movement among siblings? 

39. Describe a data structure suitable for repre- 
senting a board configuration during a chess 
game. 

40. Identify the trees below whose nodes would 
be printed in alphabetical order by the algo- 
rithm in Figure 8.23. 


W 




/ Y \ 
X z 



w 


\ 

/ Y \ 

X z 


4 1 . Modify the procedure in Figure 8.23 to print 
the "list" in reverse order. 

42. Describe a tree structure that can be used to 
store the genealogical history of a family. 

What operations are performed on the tree? If 
the tree is implemented as a linked structure, 
what pointers should be associated with each 
node? Design procedures to perform the oper- 
ations you identified above, assuming that the 
tree is implemented as a linked structure with 
the pointers you just described. Using your 
storage system, explain how one could find all 
the siblings of a person. 

4 3 . Design a procedure for finding and deleting a 
given value from a tree stored in the fashion of 
Figure 8.19. 

44. In the traditional implementation of a tree, 
each node is constructed with a separate 


pointer for each possible child. The number 
of such pointers is a design decision and rep- 
resents the maximum number of children 
any node can have. If a node has fewer chil- 
dren than pointers, some of its pointers are 
simply set to NIL. But such a node can never 
have more children than pointers. Describe 
how a tree could be implemented without 
limiting the number of children a node could 
have. 

4 5. Using the define type pseudocode statement 
introduced in Section 8.4, define a user- 
defined data type representing data regarding 
an employee of a company (such as name, 
address, job assignment, pay scale, etc.). 

4 6. Using the define type pseudocode statement 
introduced in Section 8.4, sketch a definition 
of an abstract data type representing a list of 
names. In particular, what structure would 
contain the list and what procedures would be 
provided to manipulate the list? (You do not 
need to include detailed descriptions of the 
procedures.) 

4 7. Using the define type pseudocode statement 
introduced in Section 8.4, sketch a definition 
of an abstract data type representing a queue. 
Then give pseudocode statements showing 
how instances of that type could be created 
and how entries could be inserted in and 
deleted from those instances. 

48 . a. What is the difference between a user- 
defined data type and a primitive data 
type? 

b. What is the difference between an abstract 
data type and a user-defined data type? 

4 9. Identify the data structures and procedrues 

that might appear in an abstract data type rep- 
resenting an address book. 

5 0. Identify the data structures and procedures 

that might appear in an abstract data type rep- 
resenting a simple spacecraft in a video game. 

•51 . Modify Figure 8.26 so that the class defines a 
queue rather than a stack. 
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*52 . In what way is a class more general than a tra- 
ditional abstract data type? 


be inserted between the entries at locations B5 
and C4. Using the language described in 


*53. Using instructions of the form DROS and EROS 
as described at the end of Section 8.6, write a 
complete machine language routine to push 
an entry onto a stack implemented as shown 
in Figure 8.12. Assume that the stack pointer 
is in register F and that the entry to be pushed 
is in register 5. 


Appendix C and the additional op-codes D and 
E as described at the end of Section 8.6, write 
a machine-language routine to perform the 


insertion. 


*5 5. What advantages does an instruction of the 
form DROS as described in Section 8.6 have 
over an instruction of the form DRXY? What 


*54 . Suppose each entry in a linked list consists of 
one memory cell of data followed by a pointer 
to the next list entry. Moreover, suppose that a 
new entry located at memory address AO is to 


advantage does the form DRXS as described in 
Question/Exercise 4 of Section 8.6 have over 


the form DROS? 


Social Issues 


The following questions are intended as a guide to the ethical/social/legal issues asso- 
ciated with the field of computing. The goal is not merely to answer these questions. 
You should also consider why you answered as you did and whether your justifications 
are consistent from one question to the next. 

1. Suppose a software analyst designs a data organization that allows for efficient 
manipulation of data in a particular application. How can the rights to that 
data structure be protected? Is a data structure the expression of an idea (like 
a poem) and therefore protected by copyright or do data structures fall 
through the same legal loopholes as algorithms? What about patent law? 

2. To what extent is incorrect data worse than no data? 

3. In many application programs, the size to which a stack can grow is deter- 
mined by the amount of memory available. If the available space is consumed, 
then the software is designed to produce a message such as "stack overflow" 
and terminate. In most cases this error never occurs, and the user is never 
aware of it. Who is liable if such an error occurs and sensitive information is 
lost? How could the software developer minimize his or her liability? 

4. In a data structure based on a pointer system, the deletion of an item usually 
consists of changing a pointer rather than erasing memory cells. Thus when 
an entry in a linked list is deleted, the deleted entry actually remains in 
memory until its memory space is required by other data. What ethical and 
security issues result from this persistence of deleted data? 

5. It is easy to transfer data and programs from one computer to another. Thus it 
is easy to transfer the knowledge held by one machine to many machines. In 
contrast, it sometimes takes a long time for a human to transfer knowledge to 
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another human. For example, it takes time for a human to teach another 
human a new language. What implications could this contrast in knowledge 
transfer rate have if the capabilities of machines begin to challenge the capa- 
bilities of humans? 

6 . The use of pointers allows related data to be linked in a computer's memory 
in a manner reminiscent of the way many believe information is associated in 
the human mind. How are such links in a computer's memory similar to links 
in a brain? How are they different? Is it ethical to attempt to build computers 
that more closely mimic the human mind? 

7. Has the popularization of computer technology produced new ethical issues 
or simply provided a new context in which previous ethical theories are 
applicable? 

8. Suppose the author of an introductory computer science textbook wants to 
include program examples to demonstrate concepts in the text. However, to 
obtain clarity many of the examples must be simplified versions of what 
would actually be used in professional quality software. The author knows 
that the examples could be used by unsuspecting readers and ultimately 
could find their way into significant software applications in which more 
robust techniques would be more appropriate. Should the author use the sim- 
plified examples, insist that all examples be robust even if doing so decreases 
their demonstrative value, or refuse to use such examples unless clarity and 
robustness can both be obtained? 
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Systems 


A database is a system that converts a 
large collection of data into an abstract 
tool, allowing users to search for and 
extract pertinent items of information in 
a manner that is convenient to the user. 
In this chapter we explore this subject as 
well as take side excursions into the 
related fields of data mining, which 
seeks techniques for uncovering hidden 
patterns in large data collections, and tra- 
ditional file structures, which provide 
many of the tools underlying today's 
database and data mining systems. 
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lb-day's technology is capable of storing extremely large amounts of data, but such data 
collections are useless unless we are able to extract those particular items of infor- 
mation that are pertinent to the task at hand. In this chapter we will study database 
systems and learn how these systems apply abstraction to convert large data con- 
glomerates into useful Information sources. As a related topic, we will investigate the 
rapidly expanding field of data mining, whose goal is to develop techniques for iden- 
tifying and exploring patterns within data collections. We will also examine the prin- 
ciples of traditional file structures, which provide the underpinnings for today's 
database and data mining systems. 


9.1 Database Fundamentals 

The term database refers to a collection of data that is multidimensional in the sense 
that internal links between its entries make the information accessible from a vari- 
ety of perspectives. This is in contrast to a traditional file system (Section 9.5), some- 
times called a flat file, which is a one-dimensional storage system, meaning that it 
presents its information from a single point of view. Whereas a flat file containing 
information about composers and their compositions might provide a list of compo- 
sitions arranged by composer, a database might present all the works by a single com- 
poser, all the composers who wrote a particular type of music, and perhaps the 
composers who wrote variations of another composer's work. 


The Role of Schemes 

Historically, as computing machinery found broader uses in information management, 
each application tended to be implemented as a separate system with its own collec- 
tion of data. Payroll was processed with the payroll file, the personnel department 
maintained its own employee records, and inventory was managed via an inventory 
file. This meant that much of the information required by an organization was dupli- 
cated throughout the company, while many different but related items were stored in 
separate systems. In this setting, database systems emerged as a means of integrating 
the information stored and maintained by a particular organization (Figure 9.1). With 
such a system, both processing payroll and addressing newsletters could be based on 
the same data source. 

Of course along with the benefits of data integration come disadvantages. One is 
the potential of sensitive data being accessed by unauthorized personnel. Someone 
working on the organization's newsletter might need access to employee names and 
addresses but should not have access to payroll data; similarly, an employee pro- 
cessing payroll should not have access to the other financial records of the corpora- 
tion. Thus the ability to control access to the information in the database is as 
important as the ability to share it. 

To provide different users access to different information within a database, data- 
base systems often rely on schemas and subschemas. A schema is a description of the 
entire database structure that is used by the database software to maintain the data- 



9.1 Database Fundamentals 


409 


Figure 9.1 A file versus a database organization 


a. File-oriented information system 
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base. A subschema is a description of only that portion of the database pertinent to 
a particular user& needs. For example, a schema for a university database would indi- 
cate that each student record contains such items as the current address and phone 
number of that student in addition to the student's academic record. Moreover, it 
would indicate that each student record is linked to the record of the student's faculty 
adviser. In turn, the record for each faculty member would contain the person's 
address, employment history, and so on. Based on this schema, a linkage system 
would be maintained that ultimately connected the information about a student to the 
employment history of a faculty member. 

To keep the university's registrar from using this linkage to obtain privileged infor- 
mation about the faculty, the registrar's access to the database must be restricted to 
a subschema whose description of the faculty records does not include employment 
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history. Under this subschema, the registrar could find out which faculty member is 
a particular student's adviser but could not obtain access to additional information 
about that faculty member. In contrast, the subschema for the payroll department 
would provide the employment history of each faculty member but would not include 
the linkage between students and advisers. Thus the payroll department could mod- 
ify a faculty member's salary but could not obtain the names of the students advised 
by that person. 

Database Management Systems 

A typical database application involves two software layers -an application layer and 
a database management layer (Figure 9.2). The application software handles the com- 
munication with the user of the database (perhaps a person but sometimes another 
piece of software). Thus it is the application software that determines the system's 
external characteristics. It might, for example, communicate with the user through a 
question-and-answer dialogue or a fill-in-the-blanks scenario. It might use a text-based 
format or a graphical user interface (GUI). 

The application software does not directly manipulate the database. The actual 
manipulation of the database is accomplished by another software layeT called the 
database management system (DBMS). Once the application software has deter- 
mined what action the user is requesting, it uses the DBMS as an abstract tool to 
achieve the results. If the request is to add or delete data, it is the DBMS that actually 
alters the database. If the request is to retrieve information, it is the DBMS that per- 
forms the required searches. 

This dichotomy between the application software and the DBMS has several ben- 
efits. One is that it allows for the construction and use of abstract tools, which we 
have repeatedly found to be a major simplifying concept in software design. If the 
details of how the database is actually stored are isolated within the DBMS, the design 
of the application software can be greatly simplified. For instance, with a well-designed 
DBMS, the application software does not have to be concerned with whether the data- 
base is stored on a single machine or scattered among many machines within a net- 
work as a distributed database. Instead, the DBMS would deal with these issues. 


Figure 9.2 The conceptual layers of a database implementation 
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Distributed Databases 


With the advancement of networking capabilities, database systems have grown 
to encompass databases, known as distributed databases, that consist of data 
residing on different machines. For instance, an international corporation might 
store and maintain local employee records at local sites yet link those records 
via a network to create a single distributed database. 

A distributed database might contain fragmented and/or replicated data. 
The first case is exemplified by the previous employee-records example in 
which different fragments of the database are stored in different locations. In 
the second case, duplicates of the same database component are stored at differ- 
ent locations. Such replication might occur as a means of reducing information 
retrieval time. Both cases pose problems not present in more traditional central- 
ized databases-how to disguise the distributed nature of the database so that it 
functions as a coherent system or how to ensure that replicated portions of a 
database remain duplicates of each other as updates occur. In turn, the study of 
distributed databases is a current area of research. 


allowing the application software to access the database without concern for where 
the data is actually stored. 

A second advantage of separating the application software from the DBMS is 
that such an organization provides a means for controlling access to the database. By 
dictating that the DBMS performs all access to the database, the DBMS can enforce 
the restrictions imposed by the various subschemas. In particular, the DBMS can 
use the entire database schema for its internal needs but can require that the appli- 
cation software employed by each user remain within the bounds described by that 
user's subschema. 

Still another reason for separating the user interface and actual data manipula- 
tion into two different software layers is to achieve data independence-the ability 
to change the organization of the database itself without changing the application soft- 
ware. For example, the personnel department might need to add an additional field to 
each employee's record to indicate whether the corresponding employee chose to par- 
ticipate in the company's new health insurance program. If the application software 
dealt directly with the database, such a change in the data's format could require mod- 
ifications to all application programs dealing with the database. As a result, the change 
instigated by the personnel department might cause changes to the payroll program 
as well as to the program for printing mailing labels for the company's newsletter. 

The separation between application software and a DBMS removes the need for 
such reprogramming. To implement a change in the database required by a single 
user, one needs to change only the overall schema and the subschemas of those users 
involved in the change. The subschemas of all the other users remain the same, so 
their application software, which is based on the unaltered subschemas, does not 
need to be modified. 
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Finally, we should note that the application and the database management lay- 
ers often reside on separate machines and communicate via a network, with the appli- 
cation layer playing the role of a client, and the database management layer playing 
the role of a server. 

Database Models 

We have repeatedly seen how abstraction can be used to hide internal complexities. 
Database management systems provide yet another example. They hide the com- 
plexities of a database's internal structure, allowing the user of the database to imag- 
ine that the information stored in the database is arranged in a more useful format. 
In particular, a DBMS contains routines that translate commands stated in terms of a 
conceptual view of the database into the actions required by the actual data storage 
system. This conceptual view of the database is called a database model. 

In the following sections we will considerboth the relational database model and 
the object-oriented database model. In the case of the relational database model, the 
conceptual view of the database is that of a collection of tables consisting of rows and 
columns. For example, information about a company's employees might be viewed as 
a table containing a row for each employee and columns labeled name, address, 
employee identification number, etc. In turn, the DBMS would contain routines that 
would allow the application software to select certain entries from a particular row of 
the table or perhaps to report the range of values found in the salary column-even 
though the information is not actually stored in rows and columns. 

These routines form the abstract tools used by the application software to access 
the database. More precisely, application software is often written in one of the gen- 
eral-purpose programming languages, such as those discussed in Chapter 6. These 
languages provide the basic ingredients for algorithmic expressions but lack instruc- 
tions for manipulating a database. However, a program written in one of these lan- 
guages can use the routines provided by the DBMS as prewritten subroutines-in 
effect extending the capabilities of the language in a manner that supports the con- 
ceptual image of the database model. 

The search for better database models is an ongoing process. The goal is to find 
models that allow complex data systems to be conceptualized easily, lead to concise 
ways of expressing requests for information, and produce efficient database man- 
agement systems. 


Questions 
& Exercises 


1. Identify two departments in a manufacturing plant that would have differem 
uses for the same or similar inventory information. Then, describe how the 
subschema for the two departments might differ. 

2. What is the purpose of a database model? 

3- Summarize the roles of the application software and a DBMS. 
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9.2 The Relational Model 

In this section we look more closely at the relational database model. It portrays data 
as being stored in rectangular tables, called relations, which are similar to the format 
in which information is displayed by spreadsheet programs. For example, the rela- 
tional model allows information regarding the employees of a firm to be represented 
by a relation such as that shown in Figure 9.3. 

A row in a relation is called a tuple (some say "TOO-pul," others say "TU-pul"). 
In the relation of Figure 9.3, tuples consist of the information about a particular 
employee. Columns in a relation are referred to as attributes because each entry in 
a column describes some characteristic, or attribute, of the entity represented by the 
corresponding tuple. 

Issues of Relational Design 

The first step in designing a relational database is to design the relations making up 
the database. Although this might appear to be a simple task, many subtleties are 
waiting to trap the unwary designer. 

Suppose that in addition to the information contained in the relation of Figure 9.3, 
we want to include information about the jobs held by the employees. We might want 
to include a job history associated with each employee that consists of such attributes 
as job title (secretary, office manager, floor supervisor), a job identification code 
(unique to each job), the skill code associated with each job, the department in which 
the job exists, and the period during which the employee held the job in terms of a 
starting date and termination date. (We use an asterisk as the termination date if the 
job represents the employee's current position.) 

One approach to this problem is to extend the relation in Figure 9 . 3 to include 
these attributes as additional columns in the table, as shown in Figure 9.4. However, 
close examination of the result reveals several problems. One is a lack of efficiency due 
to redundancy. The relation no longer contains one tuple for each employee but rather 
one tuple for each assignment of an employee to a job. If an employee has advanced 
in the company through a sequence of several jobs, several tuples in the new relation 
must contain the same information about the employee (name, address, identification 
number, and Social Security number). For example, the personal information about 


Figure 9.3 A relation containing employee intormatiofl 


Empl Id Name Address SSN 


25X15 

Joe E. Baker 

33 Nowhere St. 

1 1 1 223333 

34Y70 

Cheryl H. Ciark 

563 Downtown Ave. 

999009999 
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G. Jerry Smith 

1 555 Circle Dr. 

1 1 1 005555 

* 

• 

* 

• 

* 

* 

* 

. 

* 

* 

• 
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Figure 9.4 A relation containing redundancy 
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Baker and Smith is repeated because they have held more than one job. Moreover, 
when a particular position has been held by numerous employees, the department 
associated with that job along with the appropriate skill code must be repeated in each 
tuple representing an assignment of the job. For example, the description of the floor 
manager job is duplicated because more than one employee has held this position. 

Another, perhaps more serious, problem with our extended relation surfaces when 
we consider deleting information from the database. Suppose for example that Joe E. 
Baker is the only employee to hold the job identified as D7. If he were to leave the com- 
pany and be deleted from the database represented in Figure 9.4, we would lose the 
information about job D7. After all, the only tuple containing the fact that job D7 
requires a skill level of K2 is the tuple relating to Joe Baker. 

You might argue that the ability to erase only a portion of a tuple could solve the 
problem, but this would in turn introduce other complications. For instance, should 
the information relating to job F5 also be retained in a partial tuple, or does this infor- 


Database Systems for PCs 

Personal computers are used in a variety of applications, ranging from elementary 
to sophisticated. In elementary "database" applications, such as storing Christmas 
card lists or maintaining bowling league records, spreadsheet systems are often 
used in lieu of database software since the application calls for little more than 
the ability to store, print, and sort data. There are, however, true database systems 
available for the PC market, one of which is Microsoft's Access. This is a complete 
relational database system as described in Section 9.2, as well as chart- and report- 
generation software. Access provides an excellent example of how the principles 
presented in this text form the backbone of popular products on the market today. 
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mation reside elsewhere in the relation? Moreover, the temptation to use partial tuples 
is a strong indication that the design of the database can be improved. 

The cause of all these problems is that we have combined more than one concept 
in a single relation. As proposed, the extended relation in Figure 9.4 contains informa- 
tion dealing directly with employees (name, identification number, address. Social Secu- 
rity number), information about the jobs available in the company Gob identification, job 
title, department, skill code), and information regarding the relationship between 
employees and jobs (start date, termination date). On the basis of this observation, we 
can solve our problems by redesigning the system using three relations-one for each 
of the preceding categories. We can keep the original relation in Figure 9.3 (which we now 
call the EMPLOYEE relation) and insert the additional information in the form of the two 
new relations called JOB and ASSIGNMENT, which produces the database in Figure 9.5. 

A database consisting of these three relations contains the pertinent information 
about employees in the EMPLOYEE relation, about available jobs in the JOB relation, 
and about job history in the ASSIGNMENT relation. Additional information is implicitly 


Figure 9.5 An employee database consisting of three relations 
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available by combining the information from different relations. For instance, if we 
know an employee's identification number, we can find the departments in which 
that employee has worked by first finding all the jobs that employee has held using 
the ASSIGNMENT relation and then finding the departments associated with those 
jobs by means of the JOB relation (Figure 9.6). Through processes such as these, any 
information that could be obtained from the single large relation can be obtained from 
the three smaller relations without the problems previously cited. 

Unfortunately, dividing information into various relations is not always as trouble- 
free as in the preceding example. For instance, compare the original relation in Figure 
9.7, with attributes Emplld, JobTitle, and Dept, to the proposed decomposition into 
two relations. At first glance, the two-relation system might appear to contain the same 
information as the single-relation system, but, in fact, it does not. Consider for example 
the problem of finding the department in which a given employee works. This is easily 
done in the single-relation system by interrogating the tuple containing the employee 
identification number of the target employee and extracting the corresponding depart- 
ment. However, in the two-relation system, the desired information is not necessarily 


Figure 9.6 Finding the departments in which employee 23Y34 has worked 
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Figure 9.7 A relation and a proposed decomposition 


I 


E m p 1 1 d Job Title Dept 

Original relation 
containing employees, 
jobs, and departments. 


Empl Id 



Proposed 

decomposition 



available. We can find the job title of the target employee and a department having such 
a job but this does not necessarily mean that the target employee works in that partic- 
ular department, because several departments might have jobs with the same title. 

We see, then, that sometimes dividing a relation into smaller relations causes the 
loss of information, and sometimes it does not. (The latter is called a lossless decom- 
position-or sometimes a nonloss decomposition.) Such relational characteristics 
are important design considerations. The goal is to identify the relational character- 
istics that can lead to problems in database design and find ways to reorganize those 
relations to remove these problematic characteristics. 

Relational Operations 

Now that you have a basic understanding of how data can be organized in terms of the 
relational model, it is time to see how information can be extracted from a database 
consisting of relations. We begin with a look at some operations that we might want 
to perform on relations. 

At times we need to select certain tuples from a relation. To retrieve the informa- 
tion about an employee, we must select the tuple with the appropriate identification 
attribute value from the EMPLOYEE relation, or to obtain a list of the job titles in a cer- 
tain department, we must select the tuples from the JOB relation having that department 
as their department attribute. The result of such a process is another relation consisting 
of the tuples selected from the parent relation. The outcome of selecting information 
about a particular employee results in a relation containing only one tuple from the 
EMPLOYEE relation. The outcome of selecting the tuples associated with a certain depart- 
ment results in a relation that probably contains several tuples from the JOB relation. 

In short, one operation we might want to perform on a relation is to select tuples 
possessing certain characteristics and to place these selected tuples in a new relation. 
To express this operation, we adopt the syntax 

NEW «- SELECT from EMPLOYEE where Emplld = "34Y70" 
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The semantics of this statement is to create a new relation called NEW containing 
those tuples (there should be only one in this case) from the relation EMPLOYEE whose 
Emplld attribute equals 34Y70 (Figure 9.8). 

In contrast to the SELECT operation, which extracts rows from a relation, the 
PROJECT operation extracts columns. Suppose, for example, that in searching for the 
job titles in a certain department, we had already SELECTed the tuples from the JOB 
relation that pertained to the target department and placed these tuples in a new rela- 
tion called NEW 1 . The list we are seeking is the JobTitle column within this new rela- 
tion. The PROJECT operation allows us to extract this column (or columns if required) 
and place the result in a new relation. We express such an operation as 

NEW2 <- PROJECT JobTitle from NEW1 

The result is the creation of another new relation (called NEW2) that contains the single 
column of values from the JobTitle column of relation NEW1. 

As another example of the PROJECT operation, the statement 

MAIL <- PROJECT Name, Address from EMPLOYEE 

can be used to obtain a listing of the names and addresses of all employees. This list 
is in the newly created (two-column) relation called MAIL (Figure 9.9). 

Another operation used in conjunction with relational databases is the JOIN oper- 
ation. It is used to combine different relations into one relation. The JOIN of two rela- 
tions produces a new relation whose attributes consist of the attributes from the 
original relations (Figure 9.10). The names of these attributes are the same as those 
in the original relations except that each is prefixed by the relation of its origin. (If rela- 
tion A containing attributes V and W is JOINed with relation B containing attributes X, 


Figure 9.8 The SELECT operation 
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Y, and Z, then the result has five attributes named A.V, A.W, B.X, B.Y, and B . Z . ) 
This naming convention ensures that the attributes in the new relation have unique 
names, even though the original relations might have attribute names in common. 

The tuples (rows) of the new relation are produced by concatenating tuples from 
the two original relations (see again Figure 9.10). Which tuples are actually joined to 
form tuples in the new relation is determined by the condition under which the JOIN 
is constructed. One such condition is that designated attributes have the same value. 
This, in fact, is the case represented in Figure 9.10, where we demonstrate the result 
of executing the statement 

C <r— JOIN A and B where A.W - & . x 

In this example, a tuple from relation A should be concatenated with a tuple from rela- 
tion B in exactly those cases where the attributes W and X in the two tuples are equal. 
Thus the concatenation of the tuple (r, 2) from relation A with the tuple (2, m, q) from 
relation B appears in the result because the value of attribute W in the first equals the 
value of attribute X in the second. On the other hand, the result of concatenating the 
tuple (r, 2) from relation A with the tuple (5, g, p) from relation B does not appear 
in the final relation because these tuples do not share common values in attributes 
W and X. 

As another example, Figure 9.11 represents the result of executing the Statement 
C <- JOIN A and B where A.W < B.X 


Figure 9.11 
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Note that the tuples in the result are exactly those in which attribute W in relation A 
is less than attribute X in relation B. 

Let us now see how the JOIN operation can be used with the database of Figure 
9.5 to obtain a listing of all employee identification numbers along with the depart- 
ment in which each employee works. Our first observation is that the information 
required is distributed over more than one relation, and thus the process of retrieving 
the information must entail more than SELECTions and PROJECTions. In fact, the tool 
we need is the statement 

NEW1 <- JOIN ASSIGNMENT and JOB where ASSIGNMENT. Jobld = JOB.Jobld 

that produces the relation NEW1, as shown in Figure 9.12. From this relation, our prob- 
lem can be solved by first SELECTing those tuples in which ASSIGNMENT. TermDate 
equals **" [which indicates "still employed") and then PROJECTing the attributes 
ASSIGNMENT. Empl Id and JOB. Dept. In short, the information we need can be 
obtained from the database in Figure 9.5 by executing the sequence 

NEW1 .«- JOIN ASSIGNMENT and JOB where ASSIGNMENT. Jobld = JOB.Jobld 
NEW2 <- SELECT from NEW1 where ASSIGNMENT. TermDate = "*" 

LIST <- PROJECT ASSIGNMENT. Emplld, JOB. Dept from NEW2 


Figure 9.12 An application oftheJOIN operation 
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where ASSIGNMENT Jobld = JOB.Jobld 
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SQL 

Now that we have introduced the basic relational operations, let us reconsider the 
overall structure of a database system. Remember that a database is actually stored in 
a mass storage system. To relieve the application programmer from the details of such 
systems, a database management system is provided that allows the application soft- 
ware to be written in terms of a database model, such as the relational model. The 
DBMS accepts commands in terms of the model and converts them into actions rel- 
ative to the actual storage structure. This conversion is handled by a collection of rou- 
tines within the DBMS that are used by the application software as abstract tools. 
Thus a DBMS based on the relational model would include routines to perform the 
SELECT, PROJECT, and JOIN operations, which could then be called from the appli- 
cation software. In this manner the application software can be written as though the 
database were actually stored in the simple tabular form of the relational model. 

Today's relational database management systems do not necessarily provide rou- 
tines to perfonn the SELECT, PROJECT, and JOIN operations in their raw form. Instead, 
they provide routines that might be combinations of these basic steps. An example is the 
language SQL (Structured Query Language), which forms the backbone of most rela- 
tional database query systems. For example, SQL is the underlying language in the rela- 
tional database system MySQL (pronounced "My-S-QrL") used by many database servers. 

One reason for SQL's popularity is that the American National Standards Insti- 
tute has standardized it. Another reason is that it was originally developed and mar- 
keted by IBM and has thus benefited from a high level of exposure. In this section we 
explain how relational database queries are expressed in SQL. 

Although we arc about to find that a query stated in SQL is expressed in an 
imperative-sounding form, the reality is that it is essentially a declarative statement. 
You should read an SQL statement as a description of the information desired rather 
than a sequence of activities to be performed. The significance of this is that SQL 
relieves application programmers from the burden of developing algorithms for 
manipulating relations-they need merely to describe the information desired. 

For our first example of an SQL statement, let us reconsider our last query in 
which we developed a three-step process for obtaining all employee identification 
numbers along with their corresponding departments. In SQL this entire query could 
be represented by the single statement 

select Emplld, Dept 
from ASSIGNMENT, JOB 

where AS SIGNMENT . Jobld = JOB.Jobld 
and ASSIGNMENT. TermDate = '*' 

As indicated by this example, each SQL query statement can contain three clauses: a 
select clause, a from clause, and a where clause. Roughly speaking, such a statement 
is a request for the result of forming the JOIN of all the relations listed in the from 
clause, SELECTing those tuples that satisfy the conditions in the where clause, and 
then PROJECTing those tuples listed in the select clause. (Note that the terminol- 
ogy is somewhat reversed since the select clause in an SQL statement identifies the 
attributes used in the PROJECT operation.) Let us consider some simple examples. 
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The statement 

select Name, Address 
from EMPLOYEE 

produces a listing of all employee names and addresses contained in the relation 
EMPLOYEE. Note that this is merely a PROJECT operation. 

The statement 

select Emplld, Name, Address, SSNum 
from EMPLOYEE 

where Name = 'Cheryl H. Clark' 

produces all the information from the tuple associated with Cheryl H. Clark in the 
EMPLOYEE relation. This is essentially a SELECT operation. 

The statement 

select Name, Address 
from EMPLOYEE 

where Name = 'Cheryl H. Clark' 

produces the name and address of Cheryl H. Clark as contained in the EMPLOYEE rela- 
tion. This is a combination of SELECT and PROJECT operations. 

The statement 

select EMPLOYEE. Name, ASSIGNMENT. StartDate 
from EMPLOYEE, ASSIGNMENT 

where EMPLOYEE. Emplld = ASSIGNMENT. Emplld 

produces a listing of all employee names and their dates of initial employment. Note 
that this is the result of JOINing the relations EMPLOYEE and ASSIGNMENT and then 
SELECTing and PROJECTing the appropriate tuples and attributes as identified in 
the where and select clauses. 

We close by noting that SQL encompasses statements for defining the structure 
of relations, creating relations, and modifying the contents of relations as well as per- 
forming queries. For example, the following are examples ofthe insert into, delete 
from, and update statements. 

The statement 

insert into EMPLOYEE 

values ('42Z12', 'Sue A. Burt', '33 Fair St.', 

'444661 111') 

adds a tuple to the EMPLOYEE relation containing the values given; 

delete from EMPLOYEE 

where Name = 'G. Jerry Smith' 

removes the tuple relating to G. Jerry Smith from the EMPLOYEE relation; and 
update EMPLOYEE 

set Address = '1812 Napoleon Ave.' 

where Name = 'Joe E. Baker' 

changes the address in the tuple associated with Joe E. Baker in the EMPLOYEE relation. 
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Questions 
& Exercises 


1 Answer the following qU^toltslfe^SSfid on the partial information given in 
the EMPLOYEE, JOB, and ASSIGNMENT relations in Figure 9.5: 

a. Who is the secretary in the accounting department with experience in the 
personnel department? 

b. Who is the fttotf'r iifii tihfe SidteSi 

c. What job does G. Jerry Smith currently hold? 

2 . Based on th&FMFIDQYEE, JOB, and ASSB&NMEMTtt in 
Figure 9.5, write a sequence of relational operations to obtain a list of all job 
titles within the personnel department. 

3. Based on the EMPLOYEE, JOB, and ASSIGNMENT r^&lfl)01^slp¥^aMKe<dl in 
Figure 9.5, write a sequence of relational operations to obtain a list of 
employee names along with the employees' departments. 

4 Convert your answers to Questions 2 and 3 into SQL. 

5. How does the relational model provide for data independence? 

6 How are the different relations in a lttdtational database tied together? 


9.3 Object-Oriented Databases 

Another database model is based on the object-oriented paradigm. This approach 
leads to an object-oriented database consisting of objects that are linked to each 
other to reflect their relationships. For example, an object-oriented implementation 
of the employee database from the previous section could consist of three classes 
(types of objects): EMPLOYEE, JOB, and ASSIGNMENT. An object from the EMPLOYEE 
class could contain such entries as Emplld, Name, Address, and SSNum; an object 
from the class JOB could contain such entries asJobld, JobTitle, SkillCode, and 
Dept; and each object from the class ASSIGNMENT could contain entries such as 
StartDate and TermDate. 

A conceptual representation of such a database is shown in Figure 9.13 where 
the links between the various objects are represented by lines connecting the related 
objects. If we focus on an object of type EMPLOYEE, we find it linked to a collection 
of objects of type ASSIGNMENT representing the various assignments that that par- 
ticular employee has held. In turn, each of these objects of type ASSIGNMENT is linked 
to an object of type JOB representing the job associated with that assignment. Thus 
all the assignments of an employee can be found by following the links from the 
object representing that employee. Similarly, all the employees who have held a par- 
ticular job can be found by following the links from the object representing that job. 

The links between objects in an object-oriented database are normally maintained 
by the DBMS, so the details of how these links are implemented arc not a concern of 
the programmer writing application software. Instead, when a new object is added to 
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Figure 9.1 3 The associations between objects in an object-oriented database 



the database, the application software merely specifies the other objects to which it 
should be linked. The DBMS then creates any linkage system that might be required 
to record these associations. In particular, a DBMS might link the objects representing 
the assignments of a given employee in a manner similar to a linked list. 

Another task of an object-oriented DBMS is to provide permanent storage for the 
objects entrusted to it- a requirement that might seem obvious but is inherently dis- 
tinct from the manner in which objects are normally treated. Normally, when an object- 
oriented program is executed, the objects created during the program's execution are 
discarded when the program terminates. In this sense the objects are considered tran- 
sient. But objects that are created and added to a database must be saved after the pro- 
gram that created them terminates. Such objects are said to be persistent. Thus 
creating persistent objects is a significant departure from the norm. 

Proponents of object-oriented databases offer numerous arguments to show why 
the object-oriented approach to database design is better than the relational approach. 
One is that the object-oriented approach allows the entire software system (applica- 
tion software, DBMS, and the database itself) to be designed in the same paradigm. 
This is in contrast to the historically common practice of using an imperative pro- 
gramming language to develop application software for interrogating a relational data- 
base. Inherent in such a task is the clash between imperative and relational paradigms. 
This distinction is subtle at our level of study but the difference has been the source 
of many software errors over the years. Even at our level, we can appreciate that an 
object-oriented database combined with an objected-oriented application program 
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produces a homogeneous image of objects communicating with each other through- 
out the system. On the other hand, a relational database combined with an impera- 
tive application program conjures an image of two inherently different organizations 
trying to find a common interface. 

To appreciate another advantage that object-oriented databases have over their 
relational counterparts, consider the problem of storing employee names in a rela- 
tional database. If an entire name is stored as a single attribute in a relation, then 
inquiries regarding only last names are awkward. However, if the name is stored as 
three separate attributes-allowing for a first name, middle name, and last name-then 
it becomes awkward to deal with people whose names do not conform to the first- 
name, middle-name, family-name template. In an object-oriented database, these 
issues can be hidden within the object that holds the employee’s name. An employee's 
name can be stored as an intelligent object that is capable of reporting the related 
employee's name in a variety of formats. Thus, from outside these objects, it would 
be just as easy to deal with last names only as with entire names, maiden names, or 
nicknames. The details involved with each perspective would be encapsulated within 
the objects. 

This ability to encapsulate the technicalities of different data formats is advanta- 
geous in other cases as well. In a relational database, the attributes in a relation are 
part of the overall design of the database, and thus the types associated with these 
attributes permeate the entire DBMS. (Variables for temporary storage must be 
declared to be the appropriate type, and procedures for manipulating data of the var- 
ious types must be designed.) Thus, extending a relational database to include attrib- 
utes of new types (audio and video) can be problematic. In particular, a variety of 
procedures throughout the database design might need to be expanded to incorpo- 
rate these new data types. In an object-oriented design, however, the same proce- 
dures used to retrieve an object representing an employee's name can be used to 
retrieve an object representing a motion picture because the distinctions in type can 
be hidden within the objects involved. Thus the object-oriented approach appears to 
be more compatible with the construction of multimedia databases-a feature that is 
already proving to be a great advantage. 

Still another advantage the object-oriented paradigm offers to database design is the 
potential for storing intelligent objects rather than merely data. That is, an object can 
contain methods describing how it should respond to messages regarding its contents 
and relationships. For example, each object of the class EMPLOYEE in Figure 9.13 could 
contain methods for reporting and updating the information in the object as well as a 
method for reporting that employee's job history and perhaps a method for changing that 
employee's job assignment. Likewise, each object from the JOB class could have a 
method for reporting the specifics of the job and perhaps a method for reporting those 
employees who have held that particular job. Thus to retrieve an employee's job history, 
we would not need to construct an elaborate procedure. Instead, we could merely ask 
the appropriate employee object to report its job history. This ability to construct data- 
bases whose components respond intelligently to inquiries offers an exciting array of pos- 
sibilities beyond those of more traditional relational databases. 
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1. What methods would be contained in an instance of an object from the 
ASSIGNMENT class in the employee database discussed in this section? 

2. What is a persistent object? 

3. Identify some classes, as well as some of their internal characteristics, tdfo&t can 
be used in an object-oriented database dealing with a warehouse inventory. 

4. Identify an advantage that an object- at&Kfrtcd database can have over a rela- 
tional database. 


9.4 Maintaining Database Integrity 

Inexpensive database management systems for personal use are relatively simple sys- 
tems. They tend to have a single objective-to shield the user from the technical 
details of the database implementation. The databases maintained by these systems 
are relatively small and generally contain information whose loss or corruption would 
be inconvenient rather than disastrous. When a problem does arise, the user can usu- 
ally correct the erroneous items directly or reload the database from a backup copy 
and manually make the modifications required to bring that copy up to date. This 
process might be inconvenient, but the cost of avoiding the inconvenience tends to 
be greater than the inconvenience itself. In any case, the inconvenience is restricted 
to only a few people, and any financial loss is generally limited. 

In the case of large, multiuser, commercial database systems, however, the stakes 
are much higher. The cost of incorrect or lost data can be enormous and can have dev- 
astating consequences. In these environments, a major role of the DBMS is to main- 
tain the database's integrity by guarding against problems such as operations that for 
some reason are only partially completed or different operations that might interact 
inadvertently to cause inaccurate information in the database. It is this role of a DBMS 
that we address in this section. 

The Commit/Rollback Protocol 

A single transaction, such as the transfer of funds from one bank account to another, 
the cancellation of an airline reservation, or the registration of a student in a univer- 
sity course, might involve multiple steps at the database level. For example, a trans- 
fer of funds between bank accounts requires that the balance in one account be 
decremented and the balance in the other be incremented. Between such steps the 
information in the database might be inconsistent. Indeed, funds are missing during 
the brief period after the first account has been decremented but before the other has 
been incremented. Likewise, when reassigning a passenger's seat on a flight, there 
might be an instant when the passenger has no seat or an instant when the passen- 
ger list appears to be one passenger greater than it actually is. 


Questions 
& Exercises 
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In the case of large databases that are subject to heavy transaction loads, it is 
highly likely that a random snapshot will find the database in the middle of some 
transaction. A request for the execution of a transaction or an equipment malfunction 
will therefore likely occur at a time when the database is in an inconsistent state. 

Let us first consider the problem of a malfunction. The goal of the DBMS is to 
ensure that such a problem will not freeze the database in an inconsistent state. This 
is often accomplished by maintaining a log containing a record of each transaction's 
activities in a nonvolatile storage system, such as a magnetic disk. Before a transac- 
tion is allowed to alter the database, the alteration to be performed is first recorded 
in the log. Thus the log contains a permanent record of each transaction's actions. 

The point at which all the steps in a transaction have been recorded in the log is 
called the commit point. It is at this point that the DBMS has the information it 
needs to reconstruct the transaction on its own if that should become necessary. At 
this point the DBMS becomes committed to the transaction in the sense that it accepts 
the responsibility of guaranteeing that the transaction's activities will be reflected in 
the database. In the case of an equipment malfunction, the DBMS can use the infor- 
mation in its log to reconstruct the transactions that have been completed (commit- 
ted) since the last backup was made. 

If problems should arise before a transaction has reached its commit point, the 
DBMS might find itself with a partially executed transaction that cannot be completed. 
In this case the log can be used to roll back (undo) the activities actually performed 
by the transaction. In the case of a malfunction, for instance, the DBMS could recover 
by rolling back those transactions that were incomplete (noncommitted) at the time 
of the malfunction. 

Rollbacks of transactions are not restricted, however, to the process of recovering 
from equipment malfunctions. They are often a part of a DBMS's normal operation. 
For example, a transaction might be terminated before it has completed all its steps 
because of an attempt to access privileged Information, or it might be involved in a 
deadlock in which competing transactions find themselves waiting for data being used 
by each other. In these cases, the DBMS can use the log to rollback a transaction and 
thus avoid an erroneous database due to incomplete transactions. 

To emphasize the delicate nature of DBMS design, we should note that there are 
subtle problems lurking within the rollback process. The rolling back of one trans- 
action might affect database entries that have been used by other transactions. For 
example, the transaction being rolled back might have updated an account balance, 
and another transaction might have already based its activities on this updated 
value. This might mean that these additional transactions must also be roiled back, 
which might adversely affect still other transactions. The result is the problem 
known as cascading rollback. 

Locking 

We now consider the problem of a transaction being executed while the database is 
in a state of flux from another transaction, a situation that can lead to inadvertent 
interaction between the transactions and produce erroneous results. For instance, the 
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problem known as the incorrect summary problem can arise if one transaction is 
in the middle of transferring funds from one account to another when another trans- 
action tries to compute the total deposits in the bank. This could result in a total that 
is either too large or too small depending on the order in which the transfer steps are 
performed. Another possibility is known as the lost update problem, which is exem- 
plified by two transactions, each of which makes a deduction from the same account. 
If one transaction reads the account's current balance at the point when the other 
has just read the balance but has not yet calculated the new balance, then both trans- 
actions will base their deductions on the same initial balance. In turn, the effect of one 
of the deductions will not be reflected in the database. 

To solve such problems, a DBMS could force transactions to execute in their entirety 
on a one-at-a-time basis by holding each new transaction in a queue until those pre- 
ceding it have completed. But a transaction often spends a lot of time waiting for mass 
storage operations to be performed. By interweaving the execution of transactions, the 
time during which one transaction is waiting can be used by another transaction to 
process data it has already retrieved. Most large database management systems there- 
fore contain a scheduler to coordinate time-sharing among transactions in much the 
same way that a time-sharing operating system coordinates interweaving of processes 
(Section 3.3) . 

To guard against such anomalies as the incorrect summary problem and the lost 
update problem, these schedulers incorporate a locking protocol in which the items 
within a database that are currently being used by some transaction are marked as 
such. These marks are called locks; marked items are said to be locked. Two types of 
locks are common-shared locks and exclusive locks. They correspond to the two 
types of access to data that a transaction might require- shared access and exclusive 
access. If a transaction is not going to alter a data item, then it requires shared access, 
meaning that other transactions are also allowed to view the data. However, if the 
transaction is going to alter the item, it must have exclusive access, meaning that it 
must be the only transaction with access to that data. 

In a locking protocol, each time a transaction requests access to a data item, it 
must also tell the DBMS the type of access it requires. If a transaction requests shared 
access to an item that is either unlocked or locked with a shared lock, that access is 
granted and the item is marked with a shared lock. If, however, the requested item is 
already marked with an exclusive lock, the additional access is denied. If a transac- 
tion requests exclusive access to an item, that request is granted only if the item has 
no lock associated with it. In this manner, a transaction that is going to alter data pro- 
tects that data from other transactions by obtaining exclusive access, whereas several 
transactions can share access to an item if none of them are going to change it. Of 
course, once a transaction is finished with an item, it notifies the DBMS, and the asso- 
ciated lock is removed. 

Various algorithms are used to handle the case in which a transaction's access 
request is rejected. One algorithm is that the transaction is merely forced to wait until 
the requested item becomes available. This approach, however, can lead to deadlock, 
since two transactions that require exclusive access to the same two data items could 
block each other's progress if each obtains exclusive access to one of the items and then 
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insists on waiting for the other. To avoid such deadlocks, some database management 
systems give priority to older transactions. That is, if an older transaction requires 
access to an item that is locked by a younger transaction, the younger transaction is 
forced to release all of its data items, and its activities are rolled back (based on the 
log). Then, the older transaction is given access to the item it required, and the 
younger transaction is forced to start again. If a younger transaction is repeatedly 
preempted, it will grow older in the process and ultimately become one of the older 
transactions with high priority. This protocol, known as the wound- wait protocol (old 
transactions wound young transactions, young transactions wait for old ones), ensures 
that every transaction will ultimately be allowed to complete its task. 


Questions 
& Exercises 


1. What is the difference between a transaction that has reached its commit 
point and one that has not? 

2. How could a DBMS guard against extensive cascading rollback? 

3. Show how the uncontrolled interweaving of two transactions, one deducting; 
$100 from an account and the other deducting $200 from the same account, 
could produce final balances of $100, $200, and $300, assuming that the ini- 
tial balance is $400. 

4. a. Summarize the possible results of a transaction »e<qiuestmg Stored access 

to an item in a database, 

b. Summarize the possible results of a transaction requesting exclusive 
access to an item in a database. 

5. Describe a sequence of events that would lead to deadlock among transac- 
tions performing operations on a database system. 

6 . Describe how the deadlock in your answer to Question 5 could be broken. 
Would your solution require use of the database management system's log? 
Explain your answer. 


9.5 Traditional File Structures 

In this section we digress from our study of mutidimensional database systems to con- 
sider traditional file structures. These structures represent the historical beginning of 
data storage and retrieval systems from which current database technology has evolved. 
Many of the techniques developed for these structures (such as indexing and hash- 
ing) are important tools in the construction of today's massive, complex databases. 


Sequential Files 

A sequential file is a file that is accessed in a serial manner from its beginning to its 
end as though the information in the file were arranged in one long row. Examples 
include audio files, video files, files containing programs, and files containing textual 
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documents. In fact, most of the files created by a typical personal computer user are 
sequential files. For instance, when a spreadsheet is saved, its information is encoded 
and stored as a sequential file from which the spreadsheet application software can 
reconstruct the spreadsheet. 

Text files, which are sequential files in which each logical record is a single sym- 
bol encoded using ASCII or Unicode, often serve as a basic tool for constructing more 
elaborate sequential files such as an employee records file. One only needs to estab- 
lish a uniform format for representing the information about each employee as a 
string of text, encode the information according to that format, and then record the 
resulting employee records one after another as one single string of text. For exam- 
pic, one could construct a simple employee file by agreeing to enter each employee 
record as a string of 31 characters, consisting of a field of 25 characters containing the 
employee's name (filled with enough blanks to complete the 25-character field), fol- 
lowed by a field of 6 characters representing the employee's identification number. 
The final file would be a long string of encoded characters in which each 31-charac- 
ter block represents the information about a single employee (Figure 9,14). Informa- 
tion would be retrieved from the file in terms of logical records consisting of 
31 -character blocks. Within each of these blocks. Individual fields would be identified 
according to the uniform format with which the blocks were constructed. 

The data in a sequential file must be recorded in mass storage in such a way that 
the sequential nature of the file is preserved. If the mass storage system is itself 
sequential (as in the case of a magnetic tape or CD), this is a straightforward under- 
taking. We need merely record the file on the storage medium according to the sequen- 
tial properties of the medium. Then processing the file is the task of merely reading 
and processing the file's contents in the order in which they are found. This is exactly 


Figure 9.14 The structure ot a simple employee file implemented as a text file 
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the process followed in playing audio CDs, where the music is stored as a sequential 
file sector by sector along one continuous spiraling track. 

In the case of magnetic disk storage, however, the file would be scattered over dif- 
ferent sectors that could be retrieved in a variety of orders. To preserve the proper 
order, most operating systems (more precisely, the file manager) maintain a list of the 
sectors on which the file is stored. This list is recorded as part of the disk's directory 
system on the same disk as the file. By means of this list, the operating system can 
retrieve the sectors in the proper sequence as though the file were stored sequen- 
tially, even though the file is actually distributed over various portions of the disk. 

Inherent in processing a sequential file is the need to detect when the end of the 
file is reached. Generically, we refeT to the end of a sequential file as the end-of-file 
(EOF). There are a variety of ways of identifying the EOF. One is to place a special 
record, called a sentinel, at the end of the file. Another is to use the information in the 
operating system's directory system to identify a file's EOF. That is, since the operating 
system knows which sectors contain the file, it also knows where the file terminates. 

A classic example involving sequential files is payroll processing in a small com- 
pany. Here we imagine a sequential file consisting of a series of logical records, each 
of which contains the information about an employee's pay (name, employee iden- 
tification number, pay scale, etc.) from which checks must be printed on a routine 
basis. As each employee record is retrieved, that employee's pay is calculated, and the 
appropriate check produced. The activity of processing such a sequential file is exem- 
plified by the statement 

while (the EOF has not been reached) do 
(retrieve the next record from the file and process it) 

When the logical records within a sequential file are identified by key field val- 
ues (see page 52), the file is usually arranged so that the records appear in the order 
determined by the keys (perhaps alphabetical or numerical). Such an arrangement 
simplifies the task of processing the information in the file. For example, suppose 
that processing payroll requires that each employee record be updated to reflect the 
information on that employee's time sheet. If both the file containing the time sheet 
records and the file containing the employee records are in the same order according 
to the same keys, then this updating process can be handled by accessing both files 
sequentially-using the time sheet retrieved from one file to update the corresponding 
record from the other file. This is a significant improvement over the repeated search- 
ing process that would be required if the files were not in corresponding order. Thus 
updating classic sequential files is typically handled in multiple steps. First, the new 
information (such as the collection of time sheets) is recorded in a sequential file 
known as a transaction file, and this transaction file is sorted to match the order of the 
file to be updated, which is called the master file. Then, the records in the master file 
are updated by retrieving the records from both files sequentially. 

A slight variation of this updating process is the process of merging two sequen- 
tial files to form a new file containing the records from the two originals. The records 
in the input files are assumed to be arranged in ascending order according to a com- 
mon key field, and it is also assumed that the files are to be merged in a manner that 
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Figure 9.15 A procedure for merging two sequential files 


procedure MergeFifes (InputFileA, InputFileB. OutputFile) 

if (both input files at EOF} then (Stop, with OutputFile empty) 
if (InputFileA not at EOF) then (Declare its first record to be its current record) 
if (InputFileB not at EOF) then (Declare its first record to be its current record) 
while (neither input file at EOF) do 

(Put the current record with the "smaller" key field value in OutputFile; 
if (that current record is the last record in its corresponding input file) 
then (Declare that input file to be at EOF) 

else (Declare the next record in that input file to be the file's current record) 

) 

Starting with the current record in the input file that is not at EOF, 
copy the remaining records to OutputFile. 


produces an output file whose keys are also in ascending order. The classic merge 
algorithm is summarized in Figure 9.15. The underlying theme is to build the output 
file as the two input files are scanned sequentially (Figure 9.16). 


Indexed Files 

Sequential files are ideal for storing data that will be processed in the order in which 
the file's entries are stored. However, such files are inefficient when records within 
the file must be retrieved in an unpredictable order. In such situations what is needed 
is a way to identify the location of the desired logical record quickly. A popular solu- 
tion is to use an index for the file in much the same way that an index in a book is 
used to locate topics within the book. Such a file system is called an indexed file. 

An index for a file contains a list of the keys stored in the file along with entries 
indicating where the record containing each key is stored. Thus to find a particular 
record, one finds the identifying key in the index and then retrieves the block of infor- 
mation stored at the location associated with that key. 

A file's index is normally stored as a separate file on the same mass storage device 
as the indexed file. The index is usually transferred to main memory before file pro- 
cessing begins so that it is easily accessible when access to records in the file is 
required (Figure 9.17). 

A classic example of an indexed file occurs in the context of maintaining employee 
records. Here an index can be used to avoid lengthy searches when you are retrieving 
an individual record. In particular, if the file of employee records is indexed by employee 
identification numbers, then an employee's record can be retrieved quickly when the 
employee's identification number is known. Another example is found on audio CDs 
where an index is used to allow relatively quick access to individual recordings. 

Over the years numerous variations of the basic index concept have been used. 
One variation constructs an index in a hierarchical manner so that the index takes on 
a layered or tree structure. A prominent example is the hierarchical directory system 
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Figure 9.16 Applying the merge algorithm (Letters are used to represent entire records. 
The particular letter indicates the value of the record's key field.) 
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used by most operating systems for organizing file storage. In such a case, the direc- 
tories, or folders, play the role of indexes, each containing links to its subindexes. 
From this perspective, the entire fde system is merely one large indexed file. 


Hash Files 

Although indexing provides relatively quick access to entries within a data storage 
structure, it does so at the expense of index maintenance. Hashing is a technique 
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Figure9.17 Opening an indexed file 
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that provides similar access without such overhead. As in the case of an indexed sys- 
tem, hashing allows a record to be located by means of a key value. But, rather than 
looking up the key in an index, hashing identifies the location of the record directly 
from the key. 

A hash system can be summarized as follows: The data storage space is divided 
into several sections, called buckets, each of which is capable of holding several 
records. The records are dispersed among the buckets according to an algorithm that 
converts key values into bucket numbers. (This conversion from key values to bucket 
numbers is called a hash function.) Each record is stored in the bucket identified by 
this process. Therefore, a record that has been placed in the storage structure can be 
retrieved by first applying the hash function to the record's identifying key to deter- 
mine the appropriate bucket, then retrieving the contents of that bucket, and finally 
searching through the data retrieved for the desired record. 

Hashing is not only used as a means of retrieving data from mass storage but also 
as a means of retrieving items from large blocks of data stored in main memory. When 
hashing is applied to a storage structure in mass storage, the result is called a hash 
file. When applied to a storage structure within main memory, the result is usually 
called a hash table. 

Let us apply the hashing technique to the classic employee file in which each 
record contains information about a single employee in a company. First, we estab- 
lish several available areas of mass storage that will play the role of buckets. The num- 
ber of buckets and the size of each bucket are design decisions that we will consider 
later. For now, let us assume that we have created 41 buckets, which we refer to as 
bucket number 0, bucket number I , through bucket number 40. (The reason we 
selected 41 buckets rather than an even 40 will be explained shortly.) 

Let us assume that an employee's identification number will be used as the key 
for identifying the employee's record. Our next task, then, is to develop a hash func- 
tion for converting these keys into bucket numbers. Although the employee identifi- 
cation "numbers" might have the form 25X3Z or J2X35 and are therefore not numeric. 
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Authentication via Hashing 

Hashing is much more than a means of constructing efficient data storage sys- 
tems. For example, hashing can be used as a means of authenticating messages 
transferred over the Internet. The underlying theme is to hash the message in a 
secret way. This value is then transferred with the message. To authenticate the 
message, the receiver hashes the message received (in the same secret way) 
and confirms that the value produced agrees with the original value. (The odds 
of an altered message hashing to the same value are assumed to be very small.) 
If the value obtained does not agree with the original value, the message is 
exposed as being corrupted. Those who are interested might wish to search the 
Internet for information about MD5, which is a bash function used extensively 
in authentication applications. 

It is enlightening to consider error detection techniques as an application of 
hashing for authentication. For example, the use of parity bits is essentially a 
hashing system in which a bit pattern is bashed to produce either a 0 or a 1. This 
value is then transferred along with the original pattern. If the pattern ultimately 
received does not hash to that same value, the pattern is considered corrupted. 


they are stored as bit patterns, and we can interpret the bit patterns as numbers. Using 
this numeric interpretation, we can divide any key by the number ofbuckets avail- 
able and record the remainder, which in our case will be an integer in the range from 
0 to 40. Thus we can use the remainder of this division process to identify one of the 
41 buckets (Figure 9. 18). 

Using this as our hash function, we proceed to construct the file by considering 
each record individually, applying our divide-by-41 hash function to its key to obtain a 

Rgure9. 1 8 Hashing the key field value 25X3Z to one of 41 buckets 

Key field value: 25X3Z 

I 

ASCII representation: 0011001000110101010110000011001101011010 

1 

Equivalent base ten value: 21 5,643,337,562 

Remainder after division by 41 : 3 

Bucketnumber: 3 
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Figure 9.19 The rudiments of • hashing system 
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bucket number, and then storing the record in that bucket (Figure 9.19). Later, if we need 
to retrieve a record, we need merely apply our hash function to the record's key to iden- 
tify the appropriate bucket and then search that bucket for the record in question. 

At this point let us reconsider our decision to divide the storage area into 41 buck- 
ets. First, note that to obtain an efficient hash system, the records being stored should 
be distributed evenly among the buckets. If a disproportionate number of keys hap- 
pen to hash to the same bucket (a phenomenon called clustering), then a dispro- 
portionate number of records will be stored in a single bucket. In turn, retrieving a 
record from that bucket could require a time-consuming search, causing the loss of 
any benefits gained by hashing. 

Now observe that if we had chosen to divide the storage area into 40 buckets 
rather than 41, our hash function would have involved dividing the keys by the value 
40 rather than 41. But, if a dividend and a divisor both have a common factor, that fac- 
tor will be present in the remainder as well. In particular, if the keys to the entries 
stored in our hash file happened to be multiples of 5 (which is also a divisor of 40), 
then the factor of 5 would appear in the remainders when divided by 40, and the 
entries would cluster in those buckets associated with the remainders 0, 5, 10, 15, 20, 
25, 30, and 35. Similar situations would occur in the case of keys that are multiples 
of 2, 4, 8, 10, and 20, because they are all also factors of 40. Consequently, we choose 
to divide the storage area into 41 buckets because the choice of 41, being a prime 
number, eliminated the possibility of common factors and therefore reduced the 
chance of clustering. 

Unfortunately, the possibility of clustering can never be completely eliminated. 
Even with a well-designed hash function, it is highly likely that two keys will hash to 
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the same value, a phenomenon called a collision, early in the file construction 
process. To understand why, consider the following scenario. 

Suppose that we have found a hash function that arbitrarily distributes records 
among 41 buckets, that our storage system is empty, and that we are going to insert 
new records one at a time. When we insert the first record, it will be placed in an 
empty bucket. However, when we insert the next record, only 40 of the 41 buckets are 
still empty, so the probability that the second record will be placed in an empty bucket 
is only 40/41. Assuming that the second record is placed in an empty bucket, the 
third record finds only 39 empty buckets, and thus the probability of it being placed 
in one of them is 39/41. Continuing this process, we find that if the first seven records 
are placed in empty buckets, the eighth record has only a 34/41 probability of being 
placed in one of the remaining empty buckets. 

This analysis allows us to compute the probability that all the first eight records 
will be placed in empty buckets-it is the product of the probabilities of each record 
being placed in an empty bucket, assuming that the preceding entries were so placed. 
This probability is 

(41/41) (40/41) (39/41) (38/41) . . . (34/41) = .482 

The point is that the result is less than one-half. That is, it is more likely than not 
that in distributing records among 41 buckets a collision will have occurred by the time 
the eighth record is stored. 

The high probability of collisions indicates that, regardless of how well-chosen a 
hash function might be, any hash system must be designed with clustering in mind. 
In particular, it is possible that a bucket might fill up and overflow. One approach to 
this problem would be to allow the buckets to expand in size. Another approach is to 
allow buckets to spill into an overflow area that has been reserved for that purpose. 
In any case the occurrence of clustering and overflowing buckets can significantly 
degrade the performance of a hash file. 

Research has shown that, as a general rule, hash files perform well as long as the 
ratio of the number of records to the total record capacity of the file (a ratio known 
as the load factor) remains below 50 percent. However, if the load factor begins to 
creep above 75 percent, the system's performance generally degrades (clustering 
raises its ugly head, causing some buckets to fill and possibly overflow). For this rea- 
son, a hash storage system is usually reconstructed with a larger capacity if its load 
factor approaches the 75 percent value. We conclude that the efficiency of record 
retrieval obtained by implementing a hash system is not gained without cost. 


Questions 
& ExerCtSeS 

2. The merge algorithm is the heart of a popular sort algorithm called the 
merge sort. Can you discover this algorithm? (Hint: Any nonempty file can 
be considered to be a collection of one-entry files.) 


I. Follow the merge algorithm presented in Figure 9.15, assuming that one 
input file contains records with key field values equal to B and E while the 
other contains A, C, D, and F. 
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3. Is being sequential a physical or conceptual property of a file? 

4. What are the steps required when retrieving a record from an indexed file? 

5. Explain how a poorly chosen hash function can result in a hash storage sys- 
tem becoming little more than a sequential file. 

6. Suppose a hash storage system is constructed using the division hash function 
as presented in the text but with six storage buckets. For each of the following 
key values, identify the bucket in which the record with that key is placed. 
What goes wrong and why? 

a. 24 b. 30 c. 3 d. 18 e. 15 

f. 21 g. 9 h. 39 i. 27 j . 0 

7. How many people must be gathered together before the odds are that two 
members of the group will have birthdays on the same day of the year? How 
does this problem relate to the material in this section? 


9.6 Data Mining 

A rapidly expanding subject that is closely associated with database technology is data 
mining, which consists of techniques for discovering patterns in collections of data. 
Data mining has become an important tool in numerous areas including marketing, 
inventory management, quality control, loan risk management, fraud detection, and 
investment analysis. Data mining techniques even have applications in what might 
seem unlikely settings as exemplified by their use in identifying the functions of par- 
ticular genes encoded in DNA molecules and characterizing properties of organisms. 

Data mining activities differ from traditional database interrogation in that data 
mining seeks to identify previously unknown patterns as Opposed to traditional data- 
base inquiries that merely ask for the retrieval of stored facts. Moreover, data mining 
is practiced on static data collections, called data warehouses, rather than "online" 
operational databases that are subject to frequent updates. These warehouses are 
often "snapshots" of databases or collections of databases. They are used in lieu of 
the actual operational databases because finding patterns in a static system is easier 
than in a dynamic one. 

We should also note that the subject of data mining is not restricted to the domain 
of computing but has tentacles that extend far into statistics. In fact, many would 
argue that since data mining had its origins in attempts to perform statistical analy- 
sis on large, diverse data collections, it is an application of statistics rather than a field 
of computer science. 

Two common forms of data mining are class description and class discrimina- 
tion. Class description deals with identifying properties that characterize a given group 
of data items, whereas class discrimination deals with identifying properties that divide 
two groups. For example, class description techniques would be used to identify char- 
acteristics of people who buy small economical vehicles, whereas class discrimination 
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Bioinformatics 

Advances in database technology and data mining techniques are expanding the 
repertoire of tools available to biologists in research areas involving the identifi- 
cation of patterns and the classification of organic compounds. The result is a 
new field within biology called bioinformatics. Having originated in endeavors 
to decode DNA, bioinformatics now encompasses such tasks as cataloguing pro- 
teins and understanding sequences of protein interactions [called biochemical 
pathways). Although normally considered to be a part of biology, bioinformatics 
is an example of how computer science is influencing and even becoming 
ingrained in other fields. 


techniques would be used to find properties that distinguish customers who shop for 
used cars from those who shop for new ones. 

Another form of data mining is cluster analysis, which seeks to discover classes. 
Note that this differs from class description, which seeks to discover properties of 
members within classes that are already identified. More precisely, cluster analysis 
tries to find properties of data items that lead to the discovery of groupings. For exam- 
ple, in analyzing information about people’s ages who have viewed a particular motion 
picture, cluster analysis might find that the customer base breaks down into two age 
group s-a 4 tolO age group and a 25 to 40 age group. (Perhaps the motion picture 
attracted children and their parents?) 

Still another form of data mining is association analysis, which involves look- 
ing for links between data groups. It is association analysis that might reveal that cus- 
tomers who buy potato chips also buy beer and soda or that people who shop during 
the traditional weekday work hours also draw retirement benefits. 

Outlier analysis is another form of data mining. It tries to identify data entries 
that do not comply with the norm. Outlier analysis can be used to identify errors in 
data collections, to identify credit card theft by detecting sudden deviations from a cus- 
tomer's normal purchase patterns, and perhaps to identify potential terrorists by rec- 
ognizing unusual behavior. 

Finally, the form of data mining called sequential pattern analysis tries to iden- 
tify patterns ofbehavior over time. For example, sequential pattern analysis might 
reveal trends in economic systems such as equity markets or in environmental sys- 
tems such as climate conditions. 

As indicated by our last example, results from data mining can be used to predict 
nature behavior. If an entity possesses the properties that characterize a class, then the 
entity will probably behave like members of that class. However, many data mining 
projects are aimed at merely gaining abetter understanding of the data, as witnessed 
by the use of data mining in unraveling the mysteries of DNA. In any case, the scope 
of data mining applications is potentially enormous, and thus data mining promises 
to be an active area of research for years to come. 
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Note that database technology and data mining are close cousins, and thus 
research in one will have repercussions in the other. Database techniques ate used 
extensively to give data warehouses the capability of presenting data in the form of 
data cubes (data viewed from multiple perspectives-the term cube is used to con- 
jecture the image of multiple dimensions) that make data mining possible. In turn, 
as researchers in data mining improve techniques for implementing data cubes, these 
results will pay dividends in the field of database design. 

In closing, we should recognize that successful data mining encompasses much 
more than the identification of patterns within a collection of data. Intelligent judgment 
must be applied to determine whether those patterns are significant or merely coin- 
cidences. The fact that a particular convenience store has sold a high number of win- 
ning lottery tickets should probably not be considered significant to someone planning 
to buy a lottery ticket, but the discovery that customers who buy snack food also tend 
to buy frozen dinners might constitute meaningful information to a grocery store man- 
ager. Likewise, data mining encompasses a vast number of ethical issues involving the 
rights of individuals represented in the data warehouse, the accuracy and use of the 
conclusions drawn, and even the appropriateness of data mining in the first place. 


1 Why is data mining not conducted on "online" databases? 

2 Give an additional example of a pattern that might be found by each of the 
types of data mining identified in the text. 

3. Identify some different perspectives that a data cube might allow when 
mining sales data. 

4. How does data mining differ from traditional database inquiries? 


Questions 
& Exercises 


9.7 Social Impact of Database Technology 

In the past, collections of data were processed manually, meaning that relationships 
between information scattered throughout large collections were essentially undis- 
coverable. For example, the reading habits of a library's patrons might have been 
buried within the library's records, but unraveling it would have been a time-con- 
suming process. Tbday, however, most library records are automated, and in some 
cases, profiles of an individual's reading habits are within easy reach. It is now feasi- 
ble for libraries to provide such information to marketing firms, law enforcement 
agencies, political parties, employers, and private individuals. 

This example is representative of the potential problems that permeate the entire 
spectrum of database applications. Technology has made it easy to collect enormous 
amounts of data and to merge or compare different data collections to obtain rela- 
tionships that would otherwise remain buried in the heap. The ramifications, both pos- 
itive and negative, are enormous. 
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These ramifications are not merely a subject of academic debate-they are real- 
ities. Data collection is now conducted on a massive scale. In some cases the process 
is readily apparent; in others it is subtle. Examples of the first case occur when one 
is explicitly asked to provide information. This might be done in a voluntary manner, 
as in surveys or contest registration forms, or it might be done in an involuntary man- 
ner, such as when imposed by government regulations. Sometimes whether it is 
voluntary or not depends on one's point of view. Is providing personal information 
when applying for a loan voluntary or involuntary? The distinction depends on 
whether receiving the loan is a convenience or a necessity. To use a credit card at some 
retailers now requires that you allow your signature to be recorded in a digitized for- 
mat. Again, providing the information is either voluntary or involuntary depending 
on your situation. 

More subtle cases of data collection avoid direct communication with the sub- 
ject. Examples include a credit company that records the purchasing practices of the 
holders of its credit cards, sites on the World Wide Web that record the identities of 
those who visit the site, and social activists who record the license plate numbers on 
the cars parked in a targeted institution's parking lot. In these cases the subject of the 
data collection might not be aware that information is being collected and less likely 
to be aware of the existence of the databases being constructed. 

Sometimes the underlying data-collection activities are self-evident if one 
merely stops to think. For example, a grocery store might offer discounts to its reg- 
ular customers who register in advance with the store. The registration process 
might involve the issuance of identification cards that must be presented at the time 
of purchase to obtain the discount. The result is that the store is able to compile a 
record of the customers' purchases-a record whose value far exceeds the value of 
the discounts awarded. 

Of course, the force driving this boom in data collection is the value of the data, 
which is amplified by advances in database technology that allow data to be linked in 
ways that reveal information that would otherwise remain obscure. For example, the 
purchasing patterns of credit card holders can be classified and cross-listed to obtain 
customer profiles of immense marketing value. Subscription forms for body-building 
magazines can be mailed to those who have recently purchased exercise equipment, 
whereas subscription forms for dog obedience magazines can be targeted toward those 
who have recently purchased dog food. Alternative ways of combining information are 
sometimes very imaginative. Welfare records have been compared to criminal records 
to find and apprehend parole violators, and in 1984 the Selective Service in the United 
States used old birthday registration lists from a popular ice cream retailer to identify 
citizens who had failed to register for the military draft. 

There are several approaches that can be taken to protect society from abusive 
use of databases. One is to apply legal remedies. Unfortunately, passing a law against 
an action does not stop the action from occurring but merely makes the action ille- 
gal. A prime example in the United States is the Privacy Act of 1974 whose purpose 
was to protect citizens from abusive use of government databases. One provision of 
this act required government agencies to publish notice of their databases in the 
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Federal Register to allow citizens to access and correct their personal information. 
However, government agencies have been slow to comply with this provision. This 
does not necessarily imply malicious intent. In many cases the problem has been 
one of bureaucracy. But, the fact that a bureaucracy might be constructing personnel 
databases that it is unable to identify is not reassuring. 

Another, and perhaps more powerful, approach to controlling database abuse is 
public opinion. Databases will not be abused if the penalties outweigh the benefits; 
and the penalty businesses fear the most is adverse public opinion-this goes right to 
the bottom line. In the early 1990s it was public opinion that ultimately stopped major 
credit bureaus from selling mailing lists for marketing purposes. More recently, Amer- 
ica Online (a major Internet service provider) buckled under public pressure against 
its policy of selling customer-related information to telemarketers. Even government 
agencies have bowed to public opinion. In 1997 the Social Security Administration in 
the United States modified its plan to make social security records available via the 
Internet when public opinion questioned the security of the information. In these 
cases results were obtained in days- a stark contrast to the extended time periods 
associated with legal processes. 

Of course, in many cases database applications are beneficial to both the holder 
and the subject of the data, but in all cases there is a loss of privacy that should not 
be taken lightly. Such privacy issues are serious when the information is accurate, but 
they become gigantic when the information is erroneous. Imagine the feeling of hope- 
lessness if you realized that your credit rating was adversely affected by erroneous 
information. Imagine how your problems would be amplified in an environment in 
which this misinformation was readily shared with other institutions. 

Privacy problems are, and will be, a major side effect of advancing technology in 
general and database techniques in particular. The solutions to these problems will 
require an educated, alert, and active citizenry. 


1 . Should law enforcement agencies be given access to databases for the purpose 

of identifying individuals with criminal tendencies, even though the individuals 
might not have committed a crime? 

2. Should insurance companies be given access to databases for the purpose of 
identifying individuals with potential medical problems, even though the 
individuals have not shown any symptoms? 

3. Suppose you were financially comfortable. What benefits could you derive if 
this information were shared among a variety of institutions? What penalties 
could you suffer from the distribution of this same information? What if you 
were financially uncomfortable? 

d. What role does a free press have in controlling database abuse? (For example, 
to what extent does the press affect public opinion or expose abuse?) 


Questions 

Exercises 
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Chapter Review Problems 

(Asterisked problems are associated with optional sections.) 


1 . Summarize the distinction between a flat file 
and a database. 

2. What is meant by data independence? 

3. what is the role of a DBMS in the layered 
approach to a database implementation? 

4. what is the difference between a schema and 
a subschema? 

5. Identify two benefits of separating application 
software from the DBMS. 

6 . Describe the similarities between an abstract 
data type (Chapter 8) and a database model. 

7. identify the level within a database system 
(user, programmer of application software, 
designer of the DBMS software) at which each 
of the following concerns or activities occur: 

a. H ow should data be stored on a disk to 
maximize efficiency? 

b. Is there a vacancy on flight 243? 

c. H ow should a relation be organized in mass 
storage? 

d. How many times should a user be allowed 
to mistype a password before the conversa- 
tion is terminated? 

e. How can the PROJECT operation be 
implemented? 

8. Which of the following tasks are handled by a 
DBMS? 

a. Ensure that a user's access to the database 
is restricted to the appropriate subschema. 

b. Translate commands stated in terms of the 
database model into actions compatible 
with the actual data storage system. 

c. Disguise the fact that the data in the data- 
base is actually scattered among many 
computers in a network. 

9. Describe how the following information about 
airlines, flights (for a particular day), and pas- 


sengers would be represented in a relational 
database: 

Airlines: Clear Sky, Long Hop, and Tree Top 
Flights for Clear Sky: CS205, CS37, and CS102 
Flights for Long Hop: LH67 and LH89 
Flights for Tree Top: TT331 andTT809 

Smith has reservations on CS205 (seat 12B), 
CS37 (seat 18C), and LH 89 (seat 14A). 

Baker has reservations on CS37 (seat 18B) and 
LH89 (seat 14B). 

Clark has reservations on LH67 (seat 5 A) and 
TT331 (seat4B). 

10. To what extent is the order in which SELECT 
and PROJECT operations are applied to a rela- 
tion significant? That is, under what condi- 
tions will SELECTing and then PROJECTing 
produce the same results as first PROJECTing 
and then SELECTing? 

11. Give an argument showing that the "where" 
clause in the JOIN operation as described in 
Section 9.2 is not necessary. (That is, show 
that any query that uses a "where" clause 
could be restated using a JOIN operation that 
concatenated every tuple in one relation with 
every tuple in the other.) 

12. in terms of the relations shown below, what is 
the appearance of the relation RESULT after 
executing each of these instructions: 

X relation Y relation 

U V W R S 


A 

Z 

5 

B 

D 

3 

C 

Q 

5 


3 

J 

4 

K 


a. RESULT <r- PROJECT W from X 

b. RESULT «- SELECT from X where W = 5 
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a RESULT «- PROJECT S from Y 
d. RESULT *- JOIN X and Y where X.W ^.Y.R 

13. Using the commands SELECT, PROJECT, and 
JOIN, write a sequence of instructions to 
answer each of the following questions about 
parts and their manufacturers in terms of the 
following database: 


PART 

relation 

PartName 


Weigh ! 

Bolt 2X 


1 

Bolt 2Z 


1.5 

Nut V5 


0.5 


MANUFACTURER relation 
CompanyName PartName Cost 


Company X 

Bolt 2Z 

.03 

Company X 

Nut V 5 

.01 

Company Y 

Bolt 2X 

.02 

Company Y 

N u t V 5 

.01 

Company Y 

Bolt 2Z 

.04 

Company Z 

Nut V 5 

.01 


a. Which companies make Bolt 2Z? 

b. Obtain a list of the parts made by Company 
X along with each part's cost. 

c. Which companies make a part with weight 1? 

14 . Answer Problem 13 using SOL. 

15 . Using the commands SELECT, PROJECT, and 
JOIN, write sequences to answer the following 
questions about the information in the 
EMPLOYEE, JOB, and ASSIGNMENT relations in 
Figure 9.5: 

a. Obtain a list of the names and addresses of 
the company's employees. 

b. Obtain a list of the names and addresses of 
those who have worked or are working in 
the personnel department. 

c. Obtain a list of the names and addresses of 
those who are working in the personnel 
department. 

1 6. Answer the previous problem using SQL. 

17. Design a relational database containing infor- 
mation about music composers, their lives. 


and their compositions. (Avoid redundancies 
similar to those in Figure 9.4.) 

16. Design a relational database containing infor- 
mation about music performers, their record- 
ings, and the composers of the music they 
recorded. (Avoid redundancies similar to those 
in Figure 9.4.) 

1 9 . Design a relational database containing infor- 

mation about manufacturers of computing 
equipment and their products. (Avoid redun- 
dancies similar to those in Figure 9.4.) 

2 0 . Design a relational database containing infor- 

mation about publishers, magazines, and sub- 
scribers. (Avoid redundancies similar to those 
in Figure 9.4.) 

21 . Design a relational database containing 
information about parts, suppliers, and 
customers. Each part might be supplied 
by several suppliers and ordered by many 
customers. Each supplier might supply 
many parts and have many customers. 

Each customer might order many parts 
from many suppliers; in fact, the same part 
might be ordered from more than one sup- 
plier. (Avoid redundancies similar to those 
in Figure 9.4.) 

22. Write a sequence of instructions (using the 
operations SELECT, PROJECT, and JOIN) to 
retrieve the Jobld, StartDate, and TermDate 
for each job in the accounting department 
from the relational database described in 
Figure 9.5. 

23. Answer the previous problem using SQL. 

2 4. Write a sequence of instructions (using the 
operations SELECT, PROJECT, and JOIN) to 
retrieve the Name, Address, JobTitle, and 
Dept of every current employee from the rela- 
tional database described in Figure 9.5. 

25. Answer the previous problem using SQL. 

2 6. Write a sequence of instructions (using the 
operations SELECT, PROJECT, and JOIN) 
to retrieve the Name and JobTitle of each 


446 


Database Systems 


current employee from the relational database 
described in Figure 9.5. 

27. Answer the previous problem using SQL. 

28. What is the difference in the information sup- 
plied by the single relation 


Name 

Department 

TelephoneNumber 

Jones 

Sales 

555-2222 

Smith 

Sales 

555-3333 

Baker 

Personnel 

555-4444 


and the two relations 


Name Department 



29. Design a relational database containing 
information about automobile parts and their 
subparts. Be sure to allow for the fact that 
one part might contain smaller parts and at 
the same time be contained in still larger 
parts. 

30. On the basis of the database represented in 
Figure 9.5, state the question that is answered 
by the following program segment: 

TEMP <- SELECT from ASSIGNMENT 
where TermDate = 

RESULT <- PROJECT Jobld, StartDate 
from TEMP 

3 1 . Translate the query in the previous problem 
into SQL. 

32. On the basis of the database represented in 
Figure 9.5, state the question that is answered 
by the following program segment: 


TEMPI <- JOIN EMPLOYEE and ASSIGNMENT 
where EMPLOYEE. Emplld = 
ASSIGNMENT. Emplld 
TEMP2 <- SELECT from TEMPI where 
TermDate = 

RESULT «- PROJECT name, StartDate 
from TEMP2 

33 Translate the query in the previous problem 
into SQL. 

34. On the basis of the database represented in 
Figure 9.5, state the question that is answered 
by the following program segment: 

TEMPI «- JOIN EMPLOYEE and JOB 

where EMPLOYEE. Emplld = JOB. Emplld 
TEMP2 <- SELECT from TEMPI where 
Dept = "SALES" 

RESULT «- PROJECT Name from TEMP2 

35. Translate the query in the previous problem 
into SQL, 

36. Translate the SQL statement 

select JOB.JobTitle 
from ASSIGNMENT, JOB 

where ASSIGNMENT. Joblld = JOB. Jobld 
and ASSIGNMENT. Emplld = "34Y70" 

into a sequence of SELECT, PROJECT, and 
JOIN operations. 

37. Translate the SQL statement 

select ASSIGNMENT. StartDate 
from ASSIGNMENT, EMPLOYEE 
where ASSIGNMENT. Emplld = 

EMPLOYEE. Emplld 
and EMPLOYEE. Name = "Joe E. 

B aker " 

into a sequence of SELECT, PROJECT, and 
JOIN operations. 

38. Describe the effect that the following SQL 
statement would have on the database in 
Problem 13. 

insert into MANUFACTURER 

values ('Company Z\ 'Bolt 2X', .03) 
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39 . Describe the effect that the following SQL 
statement would have on the database in 
Problem 13. 

update MANUFACTURER 
set Cost = .03 

where CompanyName = 'Company Y' 
and PartName = 'Bolt 2X' 

"4 0. identify some of the objects that you would 
expect to find in an object-oriented database 
used to maintain a grocery store's inventory. 
What methods would you expect to find within 
each of these objects? 

*41. identify some of the objects that you would 
expect to find in an object-oriented database 
used to maintain records of a library's hold- 
ings. What methods would you expect to find 
within each of these objects? 

'42. what incorrect information is generated by the 
following schedule of transactions T1 and T2? 

T1 is designed to compute the sum of 
accounts A and B; T2 is designed to transfer 
$100 from account A to account B. T1 begins 
by retrieving the balance of account A; then, 
T2 performs its transfer; and finally, T1 
retrieves the balance of account B and reports 
the sum of the values it has retrieved. 

"43 . Explain how the locking protocol described in 
the text would resolve the error produced in 
Problem 42. 

*44. what effect would the wound-wait protocol 

have on the sequence of events in Problem 42 
if T1 was the younger transaction? If T2 was 
the younger transaction? 

*45. Suppose one transaction tries to add $100 to an 
account whose balance is $200 while another 
tries to withdraw $100 from the same account. 
Describe an interweaving of these transactions 
that would lead to a final balance of $100. 
Describe an interweaving of these transactions 
that would lead to a final balance of S300. 

'46. what is the difference between a transaction 
having exclusive access or shared access to an 


item in a database and why is the distinction 
important? 

*47. The problems discussed in Section 9.4 involv- 
ing concurrent transactions are not limited to 
database environments. What similar prob- 
lems would arise when accessing a document 
with word processors? (If you have a PC with a 
word processor, try to access the same docu- 
ment with two activations of the word proces- 
sor and see what happens.) 

*48. Suppose a sequential file contains 50,000 

records and 5 milliseconds is required to inter- 
rogate an entry. How long should we expect to 
wait when retrieving a record from the middle 
of the file? 

*49. List the steps that are executed in the merge 
algorithm in Figure 9.15 if one of the input 
files is empty at the start. 

*50 , Modify the algorithm in Figure 9.15 to handle 
the case in which both input files contain a 
record with the same key field value. Assume 
that these records are identical and that only 
one should appear in the output file. 

*51. Design a system by which a file stored on a 

disk can be processed as a sequential file with 
either of two different orderings. 

*52. Describe how a sequential file containing 
information about a magazine's subscribers 
could be constructed using a text file as the 
underlying structure. 

"53 . Design a technique by which a sequential file 
whose logical records are not a consistent size 
could be implemented as a text file. For exam- 
ple, suppose you wanted to construct a 
sequential file in which each logical record 
contained information about a novelist as well 
as a list of that author's works. 

"54 . What advantages does an indexed file have 

over a hash file? What advantages does a hash 
file have over an indexed file? 

*55 . The chapter drew parallels between a tradi- 
tional file index and the file directory system 
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maintained by an operating system. In what 
ways does an operating system's file directory 
differ from a traditional index? 

*56. if a hash file is partitioned into 10 buckets, 

what is the probability of at least two of three 
arbitrary records hashing to the same bucket? 
(Assume the hash function gives no bucket 
priority over the others.) How many records 
must be stored in the file until it is more likely 
for collisions to occur than not? 

*57. Solve the previous problem, assuming that the 
file is partitioned into 100 buckets instead of 
10 . 

* 58 . If we are using the division technique dis- 
cussed in this chapter as a hash function and 
the file storage area is divided into 23 buckets. 


which section should we search to find the 
record whose key, when interpreted as a 
binary value, is the integer 124? 

*59. Compare the implementation of a hash file to 
that of a homogeneous two-dimensional array. 
How are the roles of the hash function and the 
address polynomial similar? 

*60. Give one advantage that 

a. a sequential file has over an indexed file. 

b. a sequential file has over a hash file. 

c. an indexed file has over a sequential file. 

d. an indexed file has over a hash file. 

e. a hash file has over a sequential file. 

f. a hash file has over an indexed file. 

*61. In what way is a sequential file similar to a 
linked list? 


Social Issues 


The following questions are intended as a guide to the ethical/social/legal issues asso- 
ciated with the field of computing. The goal is not merely to answer these questions. 
You should also consider why you answered as you did and whether your justifications 
are consistent from one question to the next. 

1 . In the United States, DNA records of all federal prisoners are now stored in a 
database for use in criminal investigations. Would it be ethical to release this 
information for other purposes-for example, for medical research? If so, for 
what purposes? If not, why not? What are the pros and cons in each case? 

2. To what extent should a university be allowed to release information about its 
students? What about their names and addresses? What about grade distribu- 
tions without identifying the students? Is your answer consistent with your 
answer to Question 1? 

3. What restrictions are appropriate regarding the construction of databases 
about individuals? What information does a government have a right to hold 
regarding its citizens? What information does an insurance company have a 
right to hold regarding its clients? What information does a company have a 
right to hold regarding its employees? Should controls in these settings be 
implemented and, if so, how? 

4. Is it proper for a credit card company to sell the purchasing patterns of its 
clients to marketing firms? Is it acceptable for a sports car mail order business 
to sell its mailing list to a sports car magazine? Is it acceptable for the Internal 
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Revenue Service in the United States to sell the names and addresses of those 
taxpayers with significant capital gains to stockbrokers? If you cannot answer 
with an unqualified yes or no, what would you propose as an acceptable policy? 

5 . To what extent is the designer of a database responsible for how the informa- 
tion in that database is used? 

6. Suppose a database mistakenly allows unapproved access to information in 
the database. If that information is obtained and used adversely, to what 
degree do the database designers share responsibility for the misuse of the 
information? Does your answer depend on the amount of effort required by 
the perpetrator to discover the flaw in the database design and obtain the 
unauthorized information? 

7 . The prevalence of data mining raises numerous issues of ethics and privacy. 

Is your privacy infringed if data mining reveals certain characteristics about 
the overall population of your community? Does the use of data mining pro- 
mote good business practice or bigotry? To what extent is it proper to force 
citizens to participate in a census, knowing that more information will be 
extracted from the data than is explicitly requested by the individual ques- 
tionnaires? Does data mining give marketing firms an unfair advantage over 
unsuspecting audiences? To what extent is profiling good or bad? 

8. To what extent should a person or corporation be allowed to collect and hold 
information about individuals? What if the information collected is already 
publicly available although scattered among several sources? To what extent 
should a person or company be expected to protect such information? 

9. Many libraries offer a reference service so that patrons can enlist the assistance 
of a librarian when searching for information. Will the existence of the Internet 
and database technology render this service obsolete? If so, would that be a step 
forward or backward? If not, why not? How will the existence of the Internet 
and database technology effect the existence of libraries themselves? 

10. To what extent are you exposed to the possibility of identity theft? What steps 
can you take to minimize that exposure? How could you be damaged if you 
were the victim of identity theft? Should you be liable when identity theft 
occurs? 
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Artificial 

Intelligence 


In this chapter we explore the branch of 
computer science known as artificial 
intelligence. Although this field is still in 
its infancy, it has produced some aston- 
ishing results such as expert chess play- 
ers, computers that appear to learn and 
reason, and machines that coordinate 
their activities to achieve a common goal 
such as winning a soccer game. In artifi- 
cial intelligence, today's science fiction 
might well be tomorrow's reality. 
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Artificial Intelligence is the field of computer science that seeks to build autonomous 
machines-machines that can carry out complex tasks without human intervention. 
This goal requires that machines be able to perceive and reason. Such capabilities fall 
within the category of commonsense activities that, although natural for the human 
mind, are proving difficult for machines. The result is that work in the field contin- 
ues to be challenging. In this chapter we explore some of the topics in this vast area 
of research. 


10.1 Intelligence and Machines 

The field of artificial intelligence is quite large and merges with other subjects such as 
psychology, neurology, mathematics, linguistics, and electrical and mechanical engi- 
neering. To focus our thoughts, then, we begin by considering the concept of an agent 
and the types of intelligent behavior that an agent might exhibit. Indeed, much of the 
research in artificial intelligence can be categorized in terms of an agent's behavior. 

Intelligent Agents 

An agent is a "device" that responds to stimuli from its environment. It is natural to 
envision an agent as an individual machine such as a robot, although an agent might 
take other forms such as an autonomous airplane, a character in a computer video 
game, or a program communicating over the Internet (perhaps as a client or a server). 
Most agents have sensors by which they receive data from their environments and 
actuators by which they can affect their environments. Examples of sensors include 
microphones, cameras, range sensors, and air or soil sampling devices. Examples of 
actuators include wheels, legs, wings, grippers, and speech synthesizers. 

The goal of artificial intelligence is to build agents that behave intelligently. This 
means that the actions of the agent's actuators must be rational responses to the data 
received through its sensors. In the simplest case, these responses might be reflex 
actions in which each action is a predetermined response to the input data. 

Higher levels of response are required to obtain more "intelligent" behavior. For 
example, we might empower an agent with knowledge of its environment and require 
that the agent adjust its actions accordingly. The process of throwing a baseball is 
largely a reflex action but determining how and where to throw the ball requires 
knowledge of the current environment. (There is one out with runners on first and 
third.) How such real-world knowledge can be stored, updated, accessed, and ulti- 
mately applied in the decision-making process continues to be a challenging prob- 
lem in artificial intelligence. 

Another level of response is required if we want the agent to seek a goal such as 
winning a game of chess or maneuvering through a crowded passageway. Such goal- 
directed behavior requires that the agent's response, or sequence of responses, be the 
result of deliberately forming a plan of action or selecting the best action among the 
current options. 
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Agents as Movie Actors 

A computer program called Massive was used to generate the fantasy armies of 
Ores and humans for the Lord of the Rings trilogy. Each onscreen warrior was 
represented in the program as a distinct "intelligent" agent with its own physical 
characteristics and a randomly assigned personality that gave it tendencies to 
attack or flee. In test simulations for the battle of Helms Deep in the second 
film, the Ores had their tendency to flee set too high, and they simply ran away 
when confronted with the human warriors. (This was perhaps the first case of 
virtual extras considering a job too dangerous.) 


In some cases an agent's responses improve over time as the agent learns. This 
could take the form of developing procedural knowledge (learning "how") or stor- 
ing declarative knowledge (learning "what"). Learning procedural knowledge usu- 
ally involves a trial and error process by which an agent learns appropriate actions by 
being punished for poor actions and rewarded for good ones. Following this approach, 
agents have been developed that, over time, improve their abilities in competitive 
games such as checkers and chess. Learning declarative knowledge usually takes the 
form of expanding or altering the "facts" in an agent's store of knowledge. For exam- 
ple, a baseball player must repeatedly adjust his or her database of knowledge (there 
is still just one out, but now runners are on first and second) from which rational 
responses to future events are determined. 

To produce rational responses to stimuli, an agent must "understand" the stimuli 
received by its sensors. That is, an agent must be able to extract information from the 
data produced by its sensors, or in other words, an agent must be able to perceive. In 
some cases this is a straightforward process. Signals obtained from a gyroscope are eas- 
ily encoded in forms compatible with calculations for determining responses. But in 
other cases extracting information from input data is difficult. Examples include under- 
standing speech and images. Likewise, agents must be able to formulate their 
responses in terms compatible with their actuators. This might be a straightforward 
process or it might require an agent to formulate responses as complete spoken sen- 
tences-meaning that the agent must generate speech. In turn, such topics as image 
processing and analysis, natural language understanding, and speech generation are 
important areas of research. 

The agent attributes that we have identified here represent past as well as current 
areas of research. Of course, they are not totally independent of each other. We would 
like to develop agents that possess all of them, producing agents that understand the 
data received from their environments and develop new response patterns through 
a learning process whose goal is to maximize the agent's abilities. However, by isolating 
various types of rational behavior and pursuing them independently, researchers gain 
a toehold that can later be combined with progress in other areas to produce more 
intelligent agents. 
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Figure 10.1 The eight-puzzle in its solved configuration 



We close this subsection by introducing an agent that will provide a context for our 
discussion in Sections 10.2 and 10.3. The agent is designed to solve the eight-puzzle, 
which consists of eight square tiles labeled 1 through 8 mounted in a frame capable of 
holding a total of nine such tOes in three rows and three columns (Figure 10.1). Among 
the tiles in the frame is a vacancy into which any of the adjacent tiles can be pushed, 
allowing the tiles in the frame to be scrambled. The problem posed is to move the tiles 
in a scrambled puzzle back to their initial positions (Figure 10.1). 

Our agent takes the form of a box equipped with a gripper, a video camera, and a 
finger with a rubber end so that it does not slip when pushing something (Figure 10.2). 
When the agent is first turned on, its gripper begins to open and close as if asking for 
the puzzle. When we place a scrambled eight-puzzle in the gripper, the gripper closes 
on the puzzle. After a short time the machine's finger lowers and begins pushing the 
tiles around in the frame until they are back in their original positions. At this point 
the machine releases the puzzle and turns itself off. 

Figure 10.2 Our puzzle-solving machine 


4 
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This puzzle- solving machine exhibits two of the agent attributes that we have 
identified. First, it must be able to perceive in the sense that it must extract the cur- 
rent puzzle state from the image it receives from its camera. We will address issues 
of understanding images in Section 10.2. Second, it must develop and implement a 
plan for obtaining a goal. We will address these issues in Section 10.3. 


Performance Versus Simulation 

In the final analysis, the behavior of an agent is judged to be intelligent (or rational) 
by observing its input-response patterns. This leads to two approaches to research in 
artificial intelligence. One is performance oriented in which the researcher tries to 
maximize the performance of the agent. The other is simulation oriented in which 
the researcher is more interested in how the responses are produced than in the effi- 
ciency of the agent. Performance-oriented research is common in cases when the 
immediate goal is to produce a product. Simulation-oriented research is more com- 
patible with long-term research and development projects in which the goal is to 
expand our understanding of a subject. Both play important roles in the advancement 
of artificial intelligence. 

As an example, consider the fields of natural language processing and linguistics. 
These fields are closely related and benefit from research in each other, yet the under- 
lying goals are different. Linguists are interested in learning how humans process 
language, whereas researchers in the field of natural language processing are inter- 
ested in developing machines that can manipulate natural language. Thus, linguists 
operate in simulation-oriented mode-building systems whose goals are to test theo- 
ries. In contrast, researchers in natural language processing operate in performance- 
oriented mode-building systems to perform tasks. Systems produced in this latter 
mode (such as document translators and systems by which machines respond to ver- 
bal commands) rely heavily on knowledge gained by linguists but often apply "short- 
cuts" that happen to work in the restricted environment of the particular system. 

As an elementary example, consider the task of developing a shell for an operat- 
ing system that receives instructions from the outside world through verbal English 
commands. In this case, the shell (an agent) does not need to worry about the entire 
English language. More precisely, the shell does not need to distinguish between the 
various meanings of the word copy (Is it a noun or a verb? Should it carry the conno- 
tation of plagiarism?). Instead, the shell needs merely to distinguish the word copy 
from other commands such as rename and delete. Thus the shell could perform its task 
just by matching its inputs to predetermined audio patterns. The performance of such 
a system might be satisfactory but it would not be aesthetically pleasing to a linguist. 

The Turing Test 

In the past the Turing test (proposed by Alan Turing in 1950) has served as a bench- 
mark in measuring progress In the field of artificial intelligence. Turing's proposal was 
to allow a human, whom we call the interrogator, to communicate with a test subject 
by means of a typewriter system, without being told whether the test subject was a 
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The Origins of Artificial Intelligence 

The quest to build machines that mimic human behavior has a long history, 
but many would agree that the modern field of artificial intelligence had its ori- 
gins in 1950. This was the year that Alan Turing published the article Computing 
Machinery and Intelligence in which he proposed that machines could be pro- 
grammed to exhibit intelligent behavior. The name of the field - artificial intelli- 
gence-was coined a few years later in the now legendary proposal written by 
John McCarthy who suggested that a "study of artificial intelligence be carried 
out during the summer of 1956 at Dartmouth College" to explore "the conjecture 
that every aspect of learning or any other feature of intelligence can in principle 
be so precisely described that a machine can be made to simulate it." 


human or a machine. In this environment, a machine would be declared to behave 
intelligently if the interrogator was not able to distinguish it from a human. Turing 
predicted that by the year 2000 machines would have a 30 percent chance of passing 
a five-minute Turing test- a conjecture that turned out to be surprisingly accurate. 

A well-known example of a Turing test scenario arose as a result of the program 
DOCTOR (a version of the more general system called ELIZA) developed by Joseph 
Weizenbaum in the mid-1960s. This interactive program was designed to project the 
image of a Rogerian analyst conducting a psychological interview; the computer 
played the role of the analyst while the user played the patient. Internally, all that 
DOCTOR did was restructure the statements made by the patient according to some 
well-defined rules and direct them back to the patient. For example, in response to the 
statement "I am tired today," DOCTOR might have replied with "Why do you think 
you're tired today?" If DOCTOR was unable to recognize the sentence structure, it 
merely responded with something like "Go on" or "That's very interesting." 

Weizenbaum's purpose in developing DOCTOR dealt with the study of natural lan- 
guage communication. The subject of psychotherapy merely provided an environment 
in which the program could "communicate." To Weizenbaum's dismay, however, several 
psychologists proposed using the program for actual psychotherapy. (The Rogerian the- 
sis is that the patient, not the analyst, should lead the discussion during the therapeu- 
tic session, and thus, they argued, a computer could possibly conduct a discussion as 
well as a therapist could.) Moreover, DOCTOR projected the image of comprehension 
so strongly that many who "communicated" with it became subservient to the machine's 
question-and-answer dialogue. In a sense, DOCTOR passed the Turing test. The result 
was that ethical, as well as technical, issues were raised, and Weizenbaum became an 
advocate for maintaining human dignity In a world of advancing technology. 

More recent examples of Turing test "successes" include Internet viruses that carry 
on "intelligent" dialogs with a human victim in order to trick the human into dropping 
his or her malware guard. Moreover, phenomena similar to Turing tests occur in the con- 
text of computer games such as chess-playing programs. Although these programs select 
moves merely by applying brute-force techniques (similar to those we will discuss in 
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Section 10.3), humans competing against the computer often experience the sensation 
that the machine possesses creativity and even a personality. Similar sensations occur 
in robotics where machines have been built with physical attributes that project intel- 
ligent characteristics. Examples include toy robot dogs that project adorable personali- 
ties merely by tilting their heads or lifting their ears in response to a sound. 


1 Identify several types of "intelligent" actions that might be M&de by an agent. 

2. A plant placed in a dark room with a single light source grows toward the 
light. Is this an intelligent response? Does the plant possess intelligence? 
What, then, is your definition of intelligence? 

3 Suppose a vending machine is designed to dispense various products depend- 
ing on which button is pressed. Would you say that such a machine is "aware" 
of which button is pressed? What, then, is your definition of awareness? 

4. If a machine passes the Turing test, would you agree that it is i n ttelM JflttT* If 
not, would you agree that it appears to be intelligent? 


Questions 
& Exercises 


10.2 Perception 

To respond intelligently to the input from its sensors, an agent must be able to under- 
stand that input. That is, the agent must be able to perceive. In this section we explore 
two areas of research in perception that have proven to be especially challenging- 
understanding images and language. 

Understanding images 

Let us consider the problems posed by the puzzle-solving machine introduced in the 
previous section. The opening and closing of the gripper on the machine presents no 
serious obstacle, and the ability to detect the presence of the puzzle in the gripper dur- 
ing this process is straightforward because our application requires very little preci- 
sion. Even the problem of focusing the camera on the puzzle can be handled simply 
by designing the gripper to position the puzzle at a particular predetermined posi- 
tion for viewing. Consequently, the first intelligent behavior required by the machine 
is the extraction of information through a visual medium. 

It is important to realize that the problem faced by our machine when looking at 
the puzzle is not that of merely producing and storing an image. Technology has been 
able to do this for years as in the case of traditional photography and television sys- 
tems. Instead, the problem is to understand the image in order to extract the current 
status of the puzzle (and perhaps later to monitor the movement of the tiles). 

In the case of our puzzle-solving machine, the possible interpretations of the puz- 
zle image are relatively limited. We can assume that what appears is always an image 
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containing the digits 1 through 8 in a well-organized pattern. The problem is merely 
to extract the arrangement of these digits. For this, we imagine that the picture of the 
puzzle has been encoded in terms of bits in the computer's memory, with each bit rep- 
resenting the brightness level of a particular pixel. Assuming a uniform size of the 
image (the machine holds the puzzle at a predetermined location in front of the cam- 
era), our machine can detect which tile is in which position by comparing the differ- 
ent sections of the picture to prerecorded templates consisting of the bit patterns 
produced by the individual digits used in the puzzle. As matches are found, the con- 
dition of the puzzle is revealed. 

This technique of recognizing images is one method used in optical character 
readers. It has the drawback, however, of requiring a certain degree of uniformity for the 
style, size, and orientation of the symbols being read. In particular, the bit pattern pro- 
duced by a physically large character does not match the template for a smaller version 
of the same symbol, even though the shapes are the same. Moreover, you can imagine 
how the problems increase in difficulty when trying to process handwritten material. 

Another approach to the problem of character recognition is based on matching 
the geometric characteristics rather than the exact appearance of the symbols. In such 
cases the digit 1 might be characterized as a single vertical line, 2 might be an opened 
curved line joined with a horizontal straight line across the bottom, and so on. This 
method of recognizing symbols involves two steps: the first is to extract the features 
from the image being processed, the second is to compare the features to those of 
known symbols. As with the template-matching approach, this technique for recog- 
nizing characters is not foolproof. For instance, minor errors in the image can produce 
a set of entirely different geometric features, as in the case of distinguishing between 
an O and a C or, in the case of the eight-puzzle, a 3 and an 8. 

We are fortunate in our puzzle application because we do not need to understand 
images of general three-dimensional scenes. Consider, for example, the advantage we 
have by being assured that the shapes to be recognized (the digits 1 through 8) are iso- 
lated in different parts of the picture rather than appearing as overlapping images, as 
is common in more general settings. In a general photograph, for instance, one is 
faced not only with the problem of recognizing an object from different angles but also 
with the fact that some portions of the object might be hidden from view. 

The task of understanding general images is usually approached as a two-step 
process: (1) image processing, which refers to identifying characteristics of the 
image, and (2) image analysis, which refers to the process of understanding what 
these characteristics mean. We have already observed this dichotomy in the context 
of recognizing symbols by means of their geometric features. In that situation, we 
found image processing represented by the process of identifying the geometric fea- 
tures found in the image and image analysis represented by the process of identify- 
ing the meaning of those features. 

Image processing entails numerous subjects. One is edge enhancement, which is 
the process of applying mathematical techniques to clarify the boundaries between 
regions in an image. In a sense, edge enhancement is an attempt to convert a photograph 
into a line drawing. Another activity in image analysis is known as region finding. This 
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Strong Al Versus Weak Al 

The conjecture that machines can be programmed to exhibit intelligent behavior 
is known as weak Al and is accepted, to varying degrees, by a wide audience 
today. However, the conjecture that machines can be programmed to possess 
intelligence and, in fact, consciousness, which is known as strong Al , is widely 
debated. Opponents of strong Al argue that a machine is inherently different 
from a human and thus can never feel love, tell right from wrong, and think 
about itself in the same way that a human does. However, proponents of strong 
Al argue that the human mind is constructed from small components that indi- 
vidually are not human and are not conscious but, when combined, are. Why, 
they argue, would the same phenomenon not be possible with machines? 

The problem in resolving the strong Al debate is that such attributes as intel- 
ligence and consciousness are internal characteristics that cannot be identified 
directly. As Alan Turing pointed out, we credit other humans with intelligence 
because they behave intelligently-even though we cannot observe their internal 
mental states. Are we, then, prepared to grant the same latitude to a machine if it 
exhibits the external characteristics of consciousness? Why or why not? 


is the process of identifying those areas in an image that have common properties such 
as brightness, color, or texture. Such a region probably represents a section of the image 
that belongs to a single object. (It is the ability to recognize regions that allows computers 
to add color to old-fashioned black and white motion pictures.) Still another activity 
within the scope of image processing is smoothing, which is the process of removing 
flaws in the image. Smoothing keeps errors in the image from confusing the Other 
image-processing steps, but too much smoothing can cause the loss of important infor- 
mation as well. 

Smoothing, edge enhancement, and region finding are all steps toward identifying 
the various components in an image. Image analysis is the process of determining 
what these components represent and ultimately what the image means. Here one 
faces such problems as recognizing partially obstructed objects from different per- 
spectives. One approach to image analysis is to start with an assumption about what 
the image might be and then try to associate the components in the image with the 
objects whose presence is conjectured. This appears to be an approach applied by 
humans. For instance, we sometimes find it hard to recognize an unexpected object 
in a setting in which our vision is blurred, but once we have a clue to what the object 
might be, we can easily identify it. 

The problems associated with general image analysis are enormous, and much 
research in the area remains to be done. Indeed, image analysis is one of the fields 
that demonstrate how tasks that are performed quickly and apparently easily by the 
human mind continue to challenge the capabilities of machines. 
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Language Processing 

Another perception problem that has proven challenging is that of understanding lan- 
guage. The success obtained in translating formal high-level programming languages into 
machine language (Section 6.4) led early researchers to believe that the ability to pro- 
gram computers to understand natural language was only a few years away. Indeed, the 
ability to translate programs gives the illusion that the machine actually understands the 
language being translated. {Recall from Section 6.1 the story told by Grace Hopper about 
managers who thought she was teaching computers to understand German.) 

What these researchers failed to understand was the depth to which formal pro- 
gramming languages differ from natural languages such as English, German, and 
Latin. Programming languages are constructed from well-designed primitives so that 
each statement has only one grammatical structure and only one meaning. In con- 
trast, a statement in a natural language can have multiple meanings depending on its 
context or even the manner in which it is communicated. Thus, to understand natu- 
ral language, humans rely heavily on additional knowledge. 

For example, the sentences 

Norman Rockwell painted people. 


and 


Cinderella had a ball. 

have multiple meanings that cannot be distinguished by parsing or translating each 
word independently. Instead, to understand these sentences requires the ability to 
comprehend the context in which the statement is made. In other instances the 
true meaning of a sentence is not the same as its literal translation. For example, 

Do you know what time it is? 

often means "Please tell me what time it is," or if the speaker has been waiting for a 
long time, it might mean "You are very late." 

To unravel the meaning of a statement in a natural language therefore requires 
several levels of analysis. The first of these is syntactic analysis, whose major com- 
ponent is parsing. It is here that the subject of the sentence 

Mary gave John a birthday card, 
is recognized as Mary while the subject of 

John got a birthday card from Mary, 
is found to be John. 

Another level of analysis is called semantic analysis. In contrast to the parsing 
process, which merely identifies the grammatical role of each word, semantic analy- 
sis is charged with the task of identifying the semantic role of each word in the state- 
ment. Semantic analysis seeks to identify such things as the action described, the 
agent of that action (which might or might not be the subject of the sentence),' and 
the object of the action. It is through semantic analysis that the sentences "Mary gave 


10.2 Perception 


461 


John a birthday card" and "John got a birthday card from Mary" would be recognized 
as saying the same thing. 

A third level of analysis is contextual analysis. It is at this level that the context 
of the sentence is brought into the understanding process. For example, it is easy to 
identify the grammatical role of each word in the sentence 

The bat fell to the ground. 

We can even perform semantic analysis by identifying the action involved as falling, 
the agent as bat, and so on. But it is not until we consider the context of the statement 
that the meaning of the statement becomes clear. In particular, it has a different mean- 
ing in the context of a baseball game than it does in the context of cave exploration. 
Moreover, it is at the contextual level that the true meaning of the question "Do you 
know what time it is?" would finally be revealed. 

We should note that the various levels of analysis-syntactic, semantic, and con- 
textual-are not necessarily independent. The subject of the sentence 

Stampeding cattle can be dangerous. 

is the noun cattle (modified by the adjective stampeding ) if we envision the cattle stam- 
peding on their own. But the subject is the gerund stampeding (with object cattle ) in 
the context of a troublemaker whose entertainment consists of starting stampedes. 
Thus the sentence has more than one grammatical structure-which one is correct 
depends on the context. 

Another area of research in natural language processing concerns an entire doc- 
ument rather than individual sentences. Here the problems of concern fall into two 
categories: information retrieval and information extraction. Information retrieval 
refers to the task of identifying documents that relate to the topic at hand. An exam- 
ple is the problem faced by users of the World Wide Web as they try to find the sites 
that relate to a particular topic. The current state of the art is to search sites for key 
words, but this often produces an avalanche of false leads and can overlook an impor- 
tant site because it deals with "automobiles" instead of "cars." What is needed is a 
search mechanism that understands the contents of the sites being considered. The 
difficulty of obtaining such understanding is the reason many are turning to tech- 
niques such as XML to produce a semantic Web, as introduced in Section 4.3. 

Information extraction refers to the task of extracting information from docu- 
ments so that it takes a form that is useful in other applications. This might mean 
identifying the answer to a specific question or recording the information in a form 
from which questions can be answered at a later date. One such form is known as a 
template, which is essentially a questionnaire in which specifics are recorded. For 
example, consider a system for reading a newspaper. The system might make use of 
a variety of templates, one for each type of article that might appear in a newspaper. 
If the system identifies an article as reporting on a burglary, it would proceed by try- 
ing to fill in the slots in the burglary template. This template would probably request 
such items as the address of the burglary, the time and date of the burglary, the 
items taken, and so on. In contrast, if the system identifies an article as reporting on 
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Figure 10.3 A semantic net 


12, 2002 


a natural disaster, it would fill in the natural disaster template, which would lead the 
system toward identifying the type of disaster, amount of damage, and so on. 

Another form in which information extractors record information is known as a 
semantic net. This is essentially a large linked data structure in which pointers are 
used to indicate associations among the data items. Figure 10.3 shows part of a seman- 
tic net in which the information obtained from the sentence 

Mary hit John, 
has been highlighted. 


1 . How do the requirements of a video system on a rote@>fc tililftef iiff the fobot 
itself uses them to control its activities rather than relaying them to a 
human who controls the robot remotely? 

2. What tells you that the following otewtog fe TBKMlsense? How can this msight 
be programmed into a machine? 


Questions 
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3. How many blocks are in the stack represented below? How could a machine: 
be programmed to answer such questions accurately? 



4 How do you know that the two statements "Nothing is better thaifi complete 
happiness" and "A bowl of cold soup is better than nothing" do not imply that 
"A bowl of cold soup is better than complete happiness"? How can your ability 
to make this differentiation be transferred to a machine? 

5 Identify the ambiguities involved in translating the sentence "They are racing 
horses." 

6 Compare the results of parsing the following two seflteflftfesi, Then, explain 
how the sentences differ semantically. 

The farmer built the fence in the field. 

The farmer built the fence in the winter. 

7 Based on the semantic net in Figure 10.3, what is the family relationship 
between Mary and John? 


10.3 Reasoning! 


Let us now use the puzzle-solving machine introduced in Section 10.1 to explore tech- 
niques for developing agents with elementary reasoning abilities. 


Production Systems 


Once our puzzle-solving machine has deciphered the positions of the tiles from the 
visual image, its task becomes that of figuring out what moves are required to solve 
the puzzle. An approach to this problem that might come to mind is to preprogram 
the machine with solutions to all possible arrangements of the tiles. Then the 
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machine's task would merely be to select and execute the proper program. However, 
the eight-puzzle has thousands of configurations, so the idea of providing an explicit 
solution for each is not inviting. Thus, our goal is to program the machine so that it 
can construct solutions to the eight-puzzle on its own. That is, the machine must be 
programmed to perform elementary reasoning activities. 

The development of reasoning abilities within a machine has been a topic of 
research for many years. One of the results of this research is the recognition that there 
is a large class of reasoning problems with common characteristics. These common 
characteristics are isolated in an abstract entity known as a production system, 
which consists of three main components: 

1. A collection of states. Each state is a situation that might occur in the applica- 
tion environment. The beginning state is called the start (or initial) state; the 
desired state (or states) is called the goal state. (In our case, a state is a con- 
figuration of the eight-puzzle; the start state is the configuration of the puzzle 
when it is handed to the machine; the goal state is the configuration of the 
solved puzzle as shown in Figure 10.1.) 

2. A collection of productions ( rules or moves). A production is an operation that 
can be performed in the application environment to move from one state to 
another. Each production might be associated with preconditions; that is, con- 
ditions might exist that must be present in the environment before a produc- 
tion can be applied. (Productions in our case are the movements of tiles. Each 
movement of a tile has the precondition that the vacancy must be next to the 
tile in question.) 

3. A control system. The control system consists of the logic that solves the prob- 
lem of moving from the start state to the goal state. At each step in the process 
the control system must decide which of those productions whose preconditions 
are satisfied should be applied next. (Given a particular state in our eight-puz- 
zle example, there would be several tiles next to the vacancy and therefore sev- 
eral applicable productions. The control system must decide which tile to move.) 

Note that the task assigned to our puzzle-solving machine can be formulated in 
the context of a production system. In this setting the control system takes the form 
of a program. This program inspects the current state of the eight-puzzle, identifies a 
sequence of productions that leads to the goal state, and executes this sequence. It is 
therefore our task to design a control system for solving the eight-puzzle. 

An important concept in the development of a control system is that of a state 
graph, which is a convenient way of representing, or at least conceptualizing, all the 
states, productions, and preconditions in a production system. Here the term graph 
refers to a structure that mathematicians would call a directed graph, meaning a 
collection of locations called nodes connected by arrows. A state graph consists of a 
collection of nodes representing the states in the system connected by arrows repre- 
senting the productions that shift the system from one state to another. Two nodes are 
connected by an arrow in the state graph if and only if there is a production that trans- 
forms the system from the state at the origin of the arrow to the state at the destina- 
tion of the arrow. 
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We should emphasize that just as the number of possible states prevented us from 
explicitly providing preprogrammed solutions to the eight-puzzle, the problem of mag- 
nitude prevents us from explicitly representing the entire state graph. A state graph 
is therefore a way of conceptualizing the problem at hand but not something that we 
would consider drawing in its entirety. Nonetheless, you might find it helpful to con- 
sider (and possibly extend) the portion of the state graph for the eight-puzzle dis- 
played in Figure 10.4. 

When viewed in terms of the state graph, the problem faced by the control system 
becomes that of finding a sequence of arrows that leads from the start state to the goal 
state. After all, this sequence of arrows represents a sequence of productions that solves 
the original problem. Thus, regardless of the application, the task of the control system 
can be viewed as that of finding a path through a state graph. This universal view of con- 
trol systems is the prize that we obtain by analyzing problems requiring reasoning in 
terms of production systems. If a problem can be characterized in terms of a produc- 
tion system, then its solution can be formulated in terms of searching for a path. 

To emphasize this point, let us consider how other tasks can be framed in terms of 
production systems and thus performed in the context of control systems finding paths 
through state graphs. One of the classic problems in artificial intelligence is playing 
games such as chess. These games involve moderate complexity in a well-defined con- 
text and hence provide an ideal environment for testing theories. In chess the states of 
the underlying production system are the possible board configurations, the productions 


Figure10.4 A small portion of the eight-puzzle's state graph 
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are the moves of the pieces, and the control system is embodied in the players (human 
or otherwise). The start node of the state graph represents the board with the pieces in 
their initial positions. Branching from this node are arrows leading to those board con- 
figurations that can be reached after the first move in a game; branching from each of 
these nodes one finds those configurations reachable by the next move; and so on. With 
this formulation, we can imagine a game of chess as consisting of two players, each try- 
ing to find a path through a large state graph to a goal node of his or her own choosing. 

Perhaps a less obvious example of a production system is the problem of draw- 
ing logical conclusions from given facts. The productions in this context are the rules 
of logic, called inference rules, that allow new statements to be formed from old 
ones. For example, the statements "All super heroes are noble" and "Superman is a 
superhero" can be combined to produce "Superman is noble." States in such a system 
consist of collections of statements known to be true at particular points in the deduc- 
tion process: The start state is the collection of basic statements (often called axioms) 
from which conclusions are to be drawn, and a goal state is any collection of state- 
ments that contain the proposed conclusion. 

As an example. Figure 10.5 shows the portion of a state graph that might be tra- 
versed when the conclusion "Socrates is mortal" is drawn from the collection of state- 
ments "Socrates is a man," "All men are humans," and "All humans are mortal." There 

Figure 10.5 Deductive reasoning in the context of a production system 


Start state 



J-=> Socrates is a human. 


Intermediate state 


J-=> Socrates is mortal. 


Goal state 
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Small Scale to Large Scale 

A recurring phenomenon in the development and testing of theories is the tran- 
sition from small-scale experimentation to large-scale applications. Initial exper- 
imentation of a new theory often involves small, simple cases. If success is 
achieved, then the experimental environment is extended to more realistic, 
larger scale systems. Some theories are able to survive this transition; others are 
not. Sometimes success on the small scale is strong enough to encourage propo- 
nents of the theory to persist well after failures on the large scale have discour- 
aged other researchers. In some cases, such persistence ultimately pays off; in 
others it represents wasted effort. 

Such scenarios are readily observable in the field of artificial intelligence. 
One example is in the area of natural language processing, where early suc- 
cesses in limited settings led many to believe that general natural language 
understanding was just over the horizon. Unfortunately, extending success to 
the large scale has proved much more difficult, and victory is being achieved 
slowly as the result of significant effort. Another example is the subject of artifi- 
cial neural networks, a topic that came on the scene with significant fanfare, 
then faded for several years when its large-scale capabilities came under ques- 
tion, and has now returned in a more subdued atmosphere. As indicated in the 
text, several subjects within the field of artificial intelligence, as well as com- 
puter science in general, are currently undergoing this transitional test. 


we see the body of knowledge shifting from one state to another as the reasoning 
process applies appropriate productions to generate additional statements. 

Today, such reasoning systems, often implemented in logic programming lan- 
guages (Section 6.7), are the backbone of most expert systems, which are software 
packages designed to simulate the cause-and-effect reasoning that human experts 
would follow if confronted with the same situations. Medical expert systems, for exam- 
ple, are used to assist in diagnosing ailments or developing treatments. 


Search Trees 

We have seen that, in the context of a production system, a control system's job involves 
searching the state graph to find a path from the start node to a goal. A simple method 
of performing this search is to traverse each of the arrows leading from the start state 
and in each case record the destination state, then traverse the arrows leaving these new 
states and again record the results, and so on. The search for a goal spreads out from 
the start state like a drop of dye in water. This process continues until one of the new 
states is a goal, at which point a solution has been found, and the control system needs 
merely to apply the productions along the discovered path from the start state to the goal. 

The effect of this strategy is to build a tree, called a search tree, that consists of 
the part of the state graph that has been investigated by the control system. The root 
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Figure 10.6 An unsolved eight-puzzle 
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node of the search tree is the start state, and the children of each node are those states 
reachable from the parent by applying one production. Each arc between nodes in a 
search tree represents the application of a single production, and each path from the 
root to a leaf represents a path between the corresponding states in the state graph. 

The search tree that would be produced in solving the eight-puzzle from the con- 
figuration shown in Figure 10.6 is illustrated in Figure 10.7. The leftmost branch of this 


Figure 10.7 A sample search tree 
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tree represents an attempt to solve the problem by first moving the 6 tile up, the cen- 
ter branch represents the approach of moving the 2 tile to the right, and the rightmost 
branch represents moving the 5 tile down. Furthermore, the search tree shows that if 
we do begin by moving the 6 tile up, then the only production allowable next is to move 
the 8 tile to the right. (Actually, at that point we could also move the 6 tile down but that 
would merely reverse the previous production and thus be an extraneous move.) 

The goal state occurs in the last level of the search tree of Figure 10.7. Since this 
indicates that a solution has been found, the control system can terminate its search 
procedure and begin constructing the instruction sequence that will be used to solve 
the puzzle in the external environment. This turns out to be the simple process of 
walking up the search tree from the location of the goal node while pushing the pro- 
ductions represented by the tree arcs on a stack as they are encountered. Applying 
this technique to the search tree in Figure 10.7 produces the stack of productions in 
Figure 10.8. The control system can now solve the puzzle in the outside world by exe- 
cuting the instructions as they are popped from this stack. 

There is one more observation that we should make. Recall that the trees we 
discussed in Chapter 7 use a pointer system that points down the tree, thereby allow- 
ing us to move from a parent node to its children. In the case of a search tree, how- 
ever, the control system must be able to move from a child to its parent as it moves 
up the tree from the goal state to the start state. Such trees are constructed with their 
pointer systems pointing up rather than down. That is, each child node contains a 
pointer to its parent rather than the parent nodes containing pointers to their chil- 
dren. (In some applications, both sets of pointers are used to allow movement within 
the tree in both directions). 

Heuristics 

For our example in Figure 10.7, we chose a starting configuration that produces a man- 
ageable search tree. In contrast, the search tree generated in an attempt to solve a 
more complex problem could grow much larger. In a game of chess, there are 20 pos- 
sible first moves so the root node of the search tree in such a case would have 20 chil- 
dren rather than the 3 in the case of our example. Moreover, a game of chess can easily 
consist of 30 to 35 pairs of moves. Even in the case of the eight-puzzle, the search tree 

Figure 10.8 Productions stacked for later execution 


To p of stack M ove the 5 tile down. 

Move the 3 tile right. 
Move the 2 tile up. 
Move the 5 tile left. 


Move the 6 tile up. 
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can become quite large if the goal is not quickly reached. As a result, developing a full 
search tree can become as impractical as representing the entire state graph. 

One strategy for countering this problem is to change the order in which the search 
tree is constructed. Rather than building it in a breadth-first manner (meaning that 
the tree is constructed layer by layer), we can pursue the more promising paths to 
greater depths and consider the other options only if these original choices turn out 
to be false leads. This results in a depth-first construction of the search tree, mean- 
ing that the tree is constructed by building vertical paths rather than horizontal layers. 

The depth-first approach is similar to the strategy that we as humans would apply 
when faced with the eight-puzzle. We would rarely pursue several options at the same 
time, as modeled by the breadth-first approach. Instead, we probably would select 
the option that appeared most promising and follow it first. Note that we said appeared 
most promising. We rarely know for sure which option is best at a particular point. We 
merely follow our intuition, which might, of course, lead us astray. Nonetheless, the 
use of such intuitive information seems to give humans an advantage over the brute- 
force methods in which each option was given equal attention, and it would therefore 
seem prudent to apply intuitive methods in automated control systems. 

To this end, we need a way of identifying which of several states appears to be the 
most promising. Our approach is to use a heuristic, which is a quantitative value 
associated with each state that attempts to measure the "distance" from that state to 
the nearest goal. In a sense, a heuristic is a measure of projected cost. Given a choice 
between two states, the one with the smaller heuristic value is the one from which a 
goal can apparently be reached with the least cost. This state, therefore, would rep- 
resent the direction we should pursue. 

A heuristic should have two characteristics. First, it should constitute a reason- 
able estimate of the amount of work remaining in the solution if the associated state 
were reached. This means that it can provide meaningful information when selecting 
among options- the better the estimate provided by the heuristic, the better will be 
the decisions that are based on the information. Second, the heuristic should be easy 
to compute. This means that its use has a chance of benefiting the search process 
rather than of becoming a burden. If computing the heuristic is extremely complicated, 
then we might as well spend our time conducting a breadth-first search. 

A simple heuristic in the case of the eight-puzzle would be to estimate the "dis- 
tance" to the goal by counting the number of tiles that are out of place-the conjec- 
turebeing that a state in which four tiles are out of place is farther from the goal (and 
therefore less appealing) than a state in which only two tiles are out of place. How- 
ever, this heuristic does not take into account how far out of position the tiles are. If 
the two tiles are far from their proper positions, many productions could be required 
to move them across the puzzle. 

A slightly better heuristic, then, is to measure the distance each tile is from its des- 
tination and add these values to obtain a single quantity. A tile immediately adjacent 
to its final destination would be associated with a distance of one, whereas a tile whose 
corner touches the square of its final destination would be associated with a distance 
of two (because it must move at least one position vertically and another position 
horizontally). This heuristic is easy to compute and produces a rough estimate of the 
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Figure 10.9 An unsolved eight-puzzle 



These tiles are at least one 
move from their original positions. 


These tiles are at least two 
moves from their original positions. 


number of moves required to transform the puzzle from its current state to the goal. 
For instance, the heuristic value associated with the configuration in Figure 10.9 is 
seven (because tiles 2, 5, and 8 are each a distance of one from their final destinations 
while tiles 3 and 6 are each a distance of two from home). In fact, it actually takes 
seven moves to return this puzzle configuration to the solved configuration. 

Now that we have a heuristic for the eight-puzzle, the next step is to incorporate 
it into our decision-making process. Recall that a human faced with a decision tends 
to select the option that appears closest to the goal. Thus our search procedure should 
consider the heuristic of each leaf node in the search tree and pursue the search from 
a leaf node associated with the smallest value. This is the strategy adopted in Figure 
10.10, which presents an algorithm for developing a search tree and executing the 
solution obtained. 

Let us apply this algorithm to the eight-puzzle, starting from the initial configu- 
ration in Figure 10.6. First, we establish this initial state as the root node and record 
its heuristic value, which is five. Then, the first pass through the body of the while state- 
ment instructs us to add the three nodes that can be reached from the initial state, as 


Figure 10.10 An algorithm for a control system using heuristics 


Establish the start node of the state graph as the root of the 
search tree and record its heuristic value, 
while (the goal node has not been reached) do 

[Select the leftmost leaf node with the smallest heuristic 
value of all leaf nodes. 

To this selected node attach as children those nodes that 
can be reached by a single production. 

Record the heuristic of each of these new nodes next 
to the node in the search tree 

] 

Traverse the search tree from the goal node up to the root, 
pushing the production associated with each arc traversed 
onto a stack. 

Solve the original problem by executing the productions as they 
are popped off the stack. 
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Figure 1 0.1 1 trie beginnings of our heuristic search 




Heuristic values' 


shown in Figure 10.11. Note that we have recorded the heuristic value of each leaf node 
in parentheses beneath the node. 

The goal node has not been reached, so we again pass through the body of the 
while statement, this time extending our search from the leftmost node ("the leftmost 
leaf node with the smallest heuristic value"). After this, the search tree has the form 
displayed in Figure 10.12. 

The heuristic value of the leftmost leaf node is now five, indicating that this branch 
is perhaps not a good choice to pursue after all. The algorithm picks up on this and in 
the next pass through the while statement instructs us to expand the tree from the 

Figure 10.12 The search tree after two passes 
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Figure 10.13 The search tree after three passes 



rightmost node (which now is the "leftmost leaf node with the smallest heuristic value"). 
Having been expanded in this fashion, the search tree appears as in Figure 10.13. 

At this point the algorithm seems to be on the right track. Because the heuristic 
value of this last node is only three, the while statement instructs us to continue pur- 


Behavior-Based Intelligence 

Early work in artificial intelligence approached the subject in the context of 
explicitly writing programs to simulate intelligence. However, many argue 
today that human intelligence is not based on the execution of complex pro- 
grams but instead by simple stimulus-response functions that have evolved 
over generations. This theory of "intelligence" is known as behavior-based 
intelligence because "intelligent" stimulus-response functions appear to be the 
result ofbehaviors that caused certain individuals to survive and reproduce 
while others did not. 

Behavior-based intelligence seems to answer several questions in the artifi- 
cial intelligence community such as why machines based on the von Neumann 
architecture easily outperform humans in computational skills but struggle to 
exhibit common sense. Thus behavior-based intelligence promises to be a major 
influence in artificial intelligence research. As described in the text, behavior- 
based techniques have been applied in the field of artificial neural networks to 
teach neurons to behave in desired ways, in the field of genetic algorithms to 
provide an alternative to the more traditional programming process, and in 
robotics to improve the performance of machines through reactive strategies. 
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Figure 10.14 The complete search tree formed by our heuristic system 
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suing this path, and the search focuses toward the goal, producing the search tree 
appearing in Figure 10.14. Comparing this with the tree in Figure 10.7 shows that, 
even with the temporary wrong turn taken early on by the new algorithm, the use of 
heuristic information has greatly decreased the size of the search tree and produced 
a much more efficient process. 

After reaching the goal state, the while statement terminates, and we move on 
to traverse the tree from the goal node up to the root, pushing the productions 
encountered onto a stack as we go. The resultant stack appears as depicted earlier, 
in Figure 10.8. 

Finally, we are instructed to execute these productions as they are popped from 
the stack. At this point, we would observe the puzzle-solving machine lower its fin- 
ger and begin to move the tiles. 
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1. What is the significance of production systems in artificial intelligence? 

2 Draw a portion of the state graph for the eight-puzzle surrounding the node 
representing the following state: 
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3. Using a breadth-first approach, draw the search tree that is constructed by a 
control system when solving the eight-puzzle from the following start state: 


Question:* 
& Exercise? 
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4. Use pencil, paper, and the breadth-first approach to try to construct the search 
tree that is produced in solving the eight-puzzle from the following start state. 
(You do not have to finish.) What problems do you encounter? 
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5- What analogy can be drawn between our heuristic system for solving the eight- 
puzzle and a mountain climber who attempts to reach the peak by considering 
only the local terrain and always proceeding in the direction of steepest ascent? 

6 Using the heuristic presented in this section, apply the control-system algo- 
rithm of Figure 10.10 to the problem of solving the following eight-puzzle: 
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7 ’ Refine our method of computing the heuristic value for a state of the eight- 
puzzle so that the search algorithm of Figure 10.10 does not make the wrong 
choice, as it did in the example in this section. Can you find an example in 
which your heuristic still causes the search to go astray? 
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10.4 Additional Areas of Research 

In this section we explore two additional topics, handling knowledge and learning, 
which continue to challenge researchers in the field of artificial intelligence. Both involve 
capabilities that appear to be easy for human minds but apparently tax the capabilities 
of machines. For now, much of the progress in developing "intelligent" agents has been 
achieved essentially by avoiding direct confrontation with these issues-perhaps by 
applying clever shortcuts or limiting the scope in which a problem arises. 


Representing and Manipulating Knowledge 

In our discussion of perception we saw that understanding images requires a signifi- 
cant amount of knowledge about the items in the image and that the meaning of a sen- 
tence might depend on its context. These are examples of the role played by the 
warehouse ofknowledge, often called real-world knowledge, maintained by human 
minds. Somehow, humans store massive amounts of information and draw from that 
information with remarkable efficiency. Giving machines this capability is a major 
challenge in artificial intelligence. 

The underlying goal is to find ways to represent and store knowledge. This is com- 
plicated by the fact that, as we have already seen, knowledge occurs in both declarative 
and procedural forms. Thus, representing knowledge is not merely the representation of 
facts, but instead encompasses a much broader spectrum. Whether a single scheme for 
representing all forms ofknowledge will ultimately be found is therefore questionable. 

The problem, however, is notjust to represent and store knowledge. The knowl- 
edge must also be readily accessible, and achieving this accessibility is a challenge. 
Semantic nets, as introduced in Section 10.2, are often used as a means ofknowledge 
representation and storage, but extracting information from them can be problem- 
atic. For example, the significance of the statement "Mary hit John" depends on the 
relative ages of Mary and John (Are the ages 2 and 30 or vice versa?). This informa- 
tion would be stored in the complete semantic net suggested by Figure 10.3, but 
extracting such information during contextual analysis could require a significant 
amount of searching through the net. 

Yet another problem dealing with accessing knowledge is identifying knowledge 
that is implicitly, instead of explicitly, related to the task at hand. Rather than answer- 
ing the question "Did Arthur win the race?" with a blunt "No," we want a system that 
might answer with "No, he came down with the flu and was not able to compete." In 
the next section we will explore the concept of associative memory, which is one area 
of research that is attempting to solve this related information problem. However, the 
task is not merely to retrieve related information. We need systems that can distin- 
guish between related information and relevant information. For example, an answer 
such as "No, he was born in January and his sister's name is Lisa" would not be con- 
sidered a worthy response to the previous question, even though the information 
reported is in some way related. 

Another approach to developing better knowledge extraction systems has been to 
insert various forms of reasoning into the extraction process, resulting in what is called 
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meta-reasoning-meaning reasoning about reasoning. An example, originally used 
in the context of database searches, is to apply the closed- world assumption, which 
is the assumption that a statement is false unless it can be explicitly derived from the 
information available. For example, it is the closed-world assumption that allows a 
database to conclude that Nicole Smith does not subscribe to a particular magazine 
even though the database does not contain any information at all about Nicole. The 
process is to observe that Nicole Smith is not on the subscription list and then apply 
the closed-world assumption to conclude that Nicole Smith does not subscribe. 

On the surface the closed-world assumption appears trivial, but it has conse- 
quences that demonstrate how apparently innocent meta-reasoning techniques can 
have subtle, undesirable effects. Suppose, for example, that the only knowledge we 
have is the single statement 

Mickey is a mouse OR Donald is a duck. 

From this statement alone we cannot conclude that Mickey is in fact a mouse. Thus 
the closed-world assumption forces us to conclude that the statement 

Mickey is a mouse. 

is false. In a similar manner, the closed-world assumption forces us to conclude that 
the statement 

Donald is a duck. 

is false. Thus, the closed-world assumption has led us to the contradictory conclusion 
that although at least one of the statements must be true, both are false. Understanding 
the consequences of such innocent-looking meta-reasoning techniques is a goal of 
research in the fields of both artificial intelligence and database, and it also underlines 
the complexities involved in the development of intelligent systems. 

Finally, there is the problem, known as the frame problem, ofkeeping stored 
knowledge up to date in a changing environment. If an intelligent agent is going to 
use its knowledge to determine its behavior, then that knowledge must be current. But 
the amount of knowledge required to support intelligent behavior can be enormous, 
and maintaining that knowledge in a changing environment can be a massive under- 
taking. A complicating factor is that changes in an environment often alter other 
items of information indirectly and accounting for such indirect consequences is dif- 
ficult. For example, if a flower vase is knocked over and broken, your knowledge of 
the situation no longer contains the fact that water is in the vase, even though spilling 
the water was only indirectly involved with breaking the vase. Thus, to solve the 
frame problem not only requires the ability to store and retrieve massive amounts of 
information in an efficient manner, but it also demands that the storage system prop- 
erly react to indirect consequences. 

Learning 

In addition to representing and manipulating knowledge, we would like to give intel- 
ligent agents the ability to acquire new knowledge. We can always "teach" a computer- 
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based agent by writing and installing a new program or explicitly adding to its stored 
data, but we would like intelligent agents to be able to learn on their own. We want 
agents to adapt to changing environments and to perform tasks for which we cannot 
easily write programs in advance. A robot designed for household chores will be faced 
with new furniture, new appliances, new pets, and even new owners. An autonomous, 
self-driving car must adapt to variations in the boundary lines on roads. Game playing 
agents should be able to develop and apply new strategics. 

One way of classifying approaches to computer learning is by the level of human 
intervention required. At the first level is learning by imitation, in which a person 
directly demonstrates the steps in a task (perhaps by carrying out a sequence of com- 
puter operations or by physically moving a robot through a sequence of motions) and 
the computer simply records the steps. This form of learning has been used for years 
in application programs such as spreadsheets and word processors, where frequently 
occurring sequences of commands are recorded and later replayed by a single request. 
Note that learning by imitation places little responsibility on the agent. 

At the next level is learning by supervised training. In supervised training a 
person identifies the correct response for a series of examples and then the agent 
generalizes from those examples to develop an algorithm that applies to new cases. 
The series of examples is called the training set. Typical applications of supervised 
training include learning to recognize a person's handwriting or voice, learning to dis- 
tinguish between junk and welcome email, and learning how to identify a disease 
from a set of symptoms. 

A third level is learning by reinforcement. In learning by reinforcement, the 
agent is given a general rule to judge for itself when it has succeeded or failed at a task 
during trial and error. Learning by reinforcement is good for learning how to play a 
game like chess or checkers, as success or failure is easy to define. In contrast to 
supervised training, learning by reinforcement allows the agent to act autonomously 
as it learns to improve its behavior over time. 

Learning remains a challenging field of research since no general, universal prin- 
ciple has been found that covers all possible learning activities. However, there are 
numerous examples of progress. One is ALVINN (Autonomous Land Vehicle in a 
Neural Net), a system developed at Carnegie Mellon University to learn to steer a van 
with an on-board computer using a video camera for input. The approach used was 
supervised training. ALVINN collected data from a human driver and used that data 
to adjust its own steering decisions. As it learned, it would predict where to steer, 
check its prediction against the human driver's data, and then modify its parameters 
to come closer to the human's steering choice. ALVINN succeeded well enough that 
it could steer the van at 55 miles an hour, leading to additional research that has pro- 
duced control systems that have successfully driven at highway speeds in traffic. 

In contrast to developing techniques by which a single agent learns, other research 
in learning is directed toward developing techniques by which generations of agents 
learn through an evolutionary process. The field is called genetic algorithms and 
seeks to apply the theory of natural evolution to the development of intelligent agents. 
The goal is to evolve a solution to a problem by applying the principle of survival of 
the fittest. A collection of proposed solutions is established and evaluated. Then, the 
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Knowledge in Logic Programming 

An important concern in representing and storing knowledge is that it be done 
in a way that is compatible with the system that must access the knowledge. It 
is in this context that logic programming (see Section 6.7) often proves benefi- 
cial. In such systems knowledge is represented by "logic" statements such as 

Dumbo is an elephant. 

and 


X is an elephant implies X is gray. 

Such statements can be represented using notational systems that are readily 
accessible to the application of inference rules. In turn, sequences of deductive 
reasoning, such as we saw in Figure 10.5, can be implemented in a straightfor- 
ward manner. Thus, in logic programming the representation and storage of 
knowledge are well integrated with the knowledge extraction and application 
process. One might say that logic programming systems provide a "seamless" 
boundary between stored knowledge and its application. 


best are chosen and intermixed to create a new generation of solutions that hopefully 
present improvements over the original collection. By repeating this process over 
and over, the objective is to evolve better and better solutions until a successful one 
is "learned." 

When applied to the task of program development, the genetic algorithm approach 
is known as evolutionary programming. Here the goal is to develop programs by 
allowing them to evolve rather than by explicitly writing them. Researchers have 
applied evolutionary programming techniques to the program-development process 
using functional programming languages. The approach has been to start with a col- 
lection of programs that contain a rich variety of functions. The functions in this start- 
ing collection form the "gene pool" from which future generations of programs will 
be constructed. One then allows the evolutionary process to run for many genera- 
tions, hoping that by producing each generation from the best performers in the pre- 
vious generation, a solution to the target problem will evolve. 

Finally, we should recognize a phenomenon that is closely related to learning: dis- 
covery. The distinction is that learning is "target based" whereas discovery is not. The 
term discovery has a connotation of the unexpected that is not present in learning. We 
might set out to learn a foreign language or how to drive a car, but we might discover 
that those tasks are more difficult than we expected. An explorer might discover a 
large lake, whereas the goal was merely to learn what was there. 

Developing agents with the ability to discover efficiently requires that the agent 
be able to identify potentially fruitful "trains of thought." Here, discovery relies heav- 
ily on the ability to reason and the use of heuristics. Moreover, many potential appli- 
cations of discovery require that an agent be able to distinguish meaningful results 
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from insignificant ones. A data mining agent, for example, should not report every triv- 
ial relationship it finds. 

Examples of success in computer discovery systems include Bacon, named after 
the philosopher Sir Francis Bacon, that has discovered (or maybe we should say "redis- 
covered") Ohm's law of electricity, Kepler's third law of planetary motion, and the 
conservation of momentum. Perhaps more persuasive is the system AUTOCLASS 
that, using infrared spectral data, has discovered new classes of stars that were pre- 
viously unknown in astronomy-a true scientific discovery by a computer. 


Questions 
& Exercises 


1 What is meant by the term real-world knowledge, and what is its significance 
in artificial intelligence? 

2 A database about magazine subscribers typically contains a list of sub- 
scribers to each magazine but does not contain a list of those who do not 
subscribe. How, then, does such a database determine that a person does not 
subscribe to a particular magazine? 

3. Summarize the frame problem. 

4 Identify three ways of training a computer. Which one does not involve 
direct human intervention? 

5, How do evolutionary techniques differ from more traditional computer 
learning techniques? 


10.5 Artificial Neural Networks 

With all the progress that has been made in artificial intelligence, many problems in 
the field continue to tax the abilities of computers based on the von Neumann archi- 
tecture. Centra! processing units that execute sequences of instructions do not seem 
capable of perceiving and reasoning at levels comparable to those of the human mind. 
For this reason, many researchers are turning to machines with other architectures. 
One of these is the artificial neural network. 

Basic Properties 

As introduced in Chapter 2 , artificial neural networks are constructed from many 
individual processors, which we will call processing units (orjust units for short), 
in a manner that models networks of neurons in living biological systems. A biologi- 
cal neuron is a single cell with input tentacles called dendrites and an output tenta- 
cle called the axon (Figure 10.15). The signals transmitted via a cell's axon reflect 
whether the cell is in an inhibited or excited state. This state is determined by the com- 
bination of signals received by the cell's dendrites. These dendrites pick up signals 
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Figure 10.15 A neuron in a living biological system 


Axons from 



from the axons of other cells across small gaps known as synapses. Research suggests 
that the conductivity across a single synapse is controlled by the chemical composi- 
tion of the synapse. That is, whether the particular input signal will have an exciting 
or inhibiting effect on the neuron is determined by the chemical composition of the 
synapse. Thus it is believed that a biological neural network learns by adjusting these 
chemical connections between neurons. 

A processing unit in an artificial neural network is a simple device that mimics this 
basic understanding of a biological neuron. It produces an output of 1 or 0, depending 
on whether its effective input exceeds a given value, which is called the processing 
unit's threshold value. This effective input is a weighted sum of the actual Inputs, as 
represented in Figure 10.16 In this figure, the outputs of three processing units 


Figure 10.16 The activities within a processing unit 
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(denoted by v, v 2 , and w 3 j' are used as inputs to another unit. The inputs to this 
fourth unit are associated with values called weights (denoted by w p w 2 , and u> 3 ). 
The receiving unit multiplies each of its input values by the weight associated with 
that particular input position and then adds these products to form the effective 
input {v,w l + v 2 w 2 + u 3 w 3 > If this sum exceeds the processing unit’s threshold value, 
the unit produces an output of 1 (simulating a neuron's excited state); otherwise the 
unit produces a 0 as its output (simulating an inhibited state). 

Following the lead of Figure 10.16, we adopt the convention of representing pro- 
cessing units as rectangles. At the input end of the unit, we place a smaller rectangle 
for each input, and in this rectangle we write the weight associated with that input. 
Finally, we write the unit’s threshold value in the middle of the large rectangle. As an 
example. Figure 10.17 represents a processing unit with three inputs and a threshold 
value of 1.5. The first input is weighted by the value -2, the second is weighted by 3, 
and the third is weighted by - 1 . Therefore if the unit receives the inputs 1, 1, and 0, 
its effective input is(l)(-2) + (1)(3) + (0)(-l) = 1, and thus its output is 0. But, if the 
unit receives 0, 1, and 1, its effective input is (0)(-2) + (1)(3) + (1)(-1) = 2, which 
exceeds the threshold value. The unit's output will thus be 1. 

The fact that a weight can be positive or negative means that the corresponding 
input can have either an inhibiting or exciting effect on the receiving unit. (If the 
weight is negative, then a 1 at that input position reduces the weighted sum and thus 
tends to hold the effective input below the threshold value. In contrast, a positive 
weight causes the associated input to have an increasing effect on the weighted sum 
and thus increase the chances of that sum exceeding the threshold value.) Moreover, 
the actual size of the weight controls the degree to which the corresponding input is 
allowed to inhibit or excite the receiving unit. Consequently, by adjusting the values 
of the weights throughout an artificial neural network, we can program the network 
to respond to different inputs in a predetermined manner. 

As an example, the simple network presented in Figure 10.18a is programmed to 
produce an output of 1 if its two inputs differ and an output ofO otherwise. If, how- 
ever, we change the weights to those shown in Figure 10.18b, we obtain a network that 
responds with a 1 if both of its inputs are Is and with a 0 otherwise. 

We should note that the network in Figure 10.18 is far more simplistic than an 
actual biological network. A human brain contains approximately 10“ neurons with 
about 10 4 synapses per neuron. Indeed, the dendrites of a biological neuron are so 
numerous that they appear more like a fibrous mesh than the individual tentacles 
represented in Figure 10.15. 

Figure TO. 17 Representation o( a processing unit 
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Figure 1 0.1 8 A neural network with two different programs 
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Training Artificial Neural Networks 

An important feature of artificial neural networks is that they are not programmed in 
the traditional sense but instead are trained. That is, a programmer does not determine 
the values of the weights needed to solve a particular problem and then "plug" those 
values into the network. Instead, an artificial neural network learns the proper weight 
values via supervised training (Section 10.4) involving a repetitive process in which 
inputs from the training set are applied to the network and then the weights are 
adjusted by small increments so that the network's performance approaches the 
desired behavior. How the weights should be adjusted is the subject of research. What 
is needed is a strategy for modifying the weights so that each new adjustment leads 
toward the overall goal rather than destroying the progress made in the previous steps. 

To demonstrate the problem, consider the task of training the network in Figure 
10.19 (in which all the weights are set to the value 0) to produce an output of 1 exactly 


Figure 10.19 An artificial neural network 
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when its inputs are different. That is, we want the input patterns 1, 0 and 0, 1 to pro- 
duce the output 1 while the input patterns 0, 0 and 1, 1 produce the output value 0. 
(We have already seen a solution to this problem in Figure 10. 18a J Let us begin the 
training process by assigning both inputs the value 1. We observe that the output is 0 


Figure 10.20 Training an artificial neural network 
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c. The upperweight in the second processing unit is adjusted. 



d. However, the network no longer performs correctly 
for the input pattern 1,1. 
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(Figure 10.20a), which is the desired behavior, so we leave the network as it is and con- 
tinue the training process by trying the input pattern 1, 0 (Figure 10.20b). This pro- 
duces the output 0, whereas we want the output to be 1. Let us fix this by changing 
the upper weight of the second processing unit to 1 (Figure 10.20c). Now the network 
performs correctly for the input pattern 1, 0. At this point, we go back and retry the 
input pattern 1, 1. To our dismay, the network no longer processes that pattern cor- 
rectly. Indeed, it now produces an output of 1 (Figure 10.20d). Let us fix this by chang- 
ing the upper weight in the second processing unit back to 0. Alas, we are back where 
we started, and continuing this process will merely lead us through an endless train- 
ing cycle as each correction we make counteracts the previous correction. 

Fortunately, significant progress has been made in the development of success- 
ful training strategies, as testified by the ALVINN project cited in the previous section. 
Indeed, ALVINN was an artificial neural network whose composition was surpris- 
ingly simple (Figure 10.21). Its input was obtained from a 30 by 32 array of sensors. 

Figure 10.21 The structure of ALVINN (Autonomous Land Vehicle in a Neural Net) 
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each of which observed a unique portion of the video image of the road ahead and 
reported its findings to each of four processing units. (Thus, each of these four units 
had 960 inputs.) The output of each of these four units was connected to each of 30 
output units, whose outputs indicated the direction to steer. Excited processing units 
at one end of the 30 unit row indicated a sharp turn to the left, while excited units at 
the other end indicated a sharp turn to the right. 

ALVINN was trained by "watching" a human drive while it made its own steering 
decisions, comparing its decisions to those of the human, and making slight modifi- 
cations to its weights to bring its decisions closer to those of the human. There was, 
however, an interesting side issue. Although ALVINN learned to Steer following this 
simple technique, ALVINN did not learn how to recover from mistakes. Thus, the 
data collected from the human was artificially enriched to include recovery situations 
as well. (One approach to this recovery training that was initially considered was to 
have the human swerve the vehicle so that ALVINN could watch the human recover 
and thus learn how to recover on its own. But unless ALVINN was disabled while the 
human performed the initial swerve procedure, ALVINN learned to swerve as well as 
to recover- an obviously undesirable trait.) 

Associative Memory 

The human mind has the amazing ability to retrieve information that is associated 
with a current topic of consideration. When we experience certain smells, we might 
readily recall memories of our childhood. The sound of a friend's voice might con- 
jure an image ofthe person or perhaps memories of good times. Certain music might 
generate thoughts of particular holiday seasons. These are examples of associative 
memory-the retrieval of information that is associated with, or related to, the infor- 
mation at hand. 

To construct machines with associative memory has been a goal of research for 
many years. One approach is to apply techniques of artificial neural networks. For 
instance, consider a network consisting of many processing units that are intercon- 
nected to form a web with no inputs or outputs. (In some designs, called Hopfield net- 
works, the output of each processing unit is connected as input to each of the other 
units, in other cases the output of a unit might be connected only to its immediate 
neighbors.) Each unit can be in its excited or inhibited state. If we represent an excited 
state by 1 and an inhibited state by 0, then the condition ofthe entire network can be 
envisioned as a configuration of Os and Is. Now suppose that the network is pro- 
grammed in such a way that certain configurations of Os and Is are stable in the sense 
that when the network finds itself in one of these configurations, it will remain in 
that configuration. However, if the network is in a nonstable configuration, then the 
interaction ofthe processing units will cause the configuration to change-and con- 
tinue changing until it wanders into a stable configuration. 

If we start the network in a nonstable configuration that is close to a stable one, 
we would expect it to wander to that stable configuration. In a sense, when given a 
part of a stable configuration, the network is able to complete the configuration. Or, 
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in other words, it is able to Find the bit pattern that is associated with the partial pat- 
tern it is given. Thus if some of the bits are used to encode smells and others are used 
to encode childhood memories, then initializing the smell bits according to a certain 
stable configuration could cause the remaining bits to find their way to the associ- 
ated childhood memory. 

Let us consider the artificial neural network shown in Figure 10.22. Each circle 
in the figure represents a processing unit whose threshold value is recorded inside the 
circle. The lines connecting circles represent two-way connections between the cor- 
responding units. That is, a line connecting two units indicates that the output of 
each unit is connected as an input to the other. Thus the output of the center unit is 
connected as an input to each of the units around the perimeter, and the output of each 
of the units around the perimeter is connected as an input to the center unit as well 
as an input to each of its immediate neighbors on the perimeter. Two connected units 
associate the same weight with each other's output. This common weight is recorded 
next to the line connecting the units. Thus the unit at the top of the diagram associ- 
ates a weight of -1 with the input it receives from the center unit and a weight of 1 
with the inputs it receives from its two neighbors on the perimeter. Likewise, the cen- 
ter unit associates a weight of-1 with each of the values it receives from the units 
around the perimeter. 

The network operates in discrete steps in which all processing units respond to 
their inputs in a synchronized manner. Tb determine the next configuration of the 
network from its current configuration, we determine the effective inputs of each unit 
throughout the network and then allow all the units to respond to their inputs at the 
same time. The effect is that the entire network follows a coordinated sequence of 
compute effective inputs, respond to inputs, compute effective inputs, respond to 
inputs, etc. 

Figure 10.22 An artificial neural network implementing an associative memory 
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Consider the sequence of events that would occur if we initialized the network 
with its two rightmost units inhibited and the other units excited (Figure 10.23a). The 
two leftmost units would have effective inputs of 1, so they would remain excited. 
But, their neighbors on the perimeter would have effective inputs of 0, so they would 
become inhibited. Likewise, the center unit would have an effective input of-4, so it 
would become inhibited. Thus the entire network would shift to the configuration 
shown in Figure 10.23b in which only the two leftmost units are excited. Since the cen- 
ter unit would now be inhibited, the excited conditions of the leftmost units would 
cause the top and bottom units to become excited again. Meanwhile, the center unit 
would remain inhibited since it would have an effective input of- 2. Thus the network 
would shift to the configuration in Figure 10.23c, which would then lead to the con- 
figuration in Figure 10.23d. (You might wish to confirm that a blinking phenomenon 
would occur if the network were initialized with only the upper four units excited. The 
top unit would remain excited while its two neighbors on the perimeter and the cen- 
ter unit would alternate between being excited and inhibited.) 

Finally, observe that the network has two stable configurations: one in which the 
center unit is excited and the others are inhibited, and another configuration in which 


Figure 10.23 The steps leading to a stable configuration 
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the center unit is inhibited and the others are excited. If we initialize the network 
with the center unit excited and no more than two of the other units excited, the net- 
work will wander to the former stable configuration. If we initialize the network with 
at least four adjacent units on the perimeter in their excited states, the network will 
wander to the latter configuration. Thus we could say that the network associates the 
former stable configuration with initial patterns in which its center unit and fewer than 
three of its perimeter units are excited, and associates the latter stable configuration 
with initial patterns in which four or more of its perimeter units are excited. In short, 
the network represents an elementary associative memory. 


1 . What is the output of the following processing unit when both its inputs are 
Is? What about the input patterns 0, 0; 0, 1; and 1, 0? 


* 

1 

-1 

.5 


2. Adjust the weights and threshold value of the following processing unit so 
that its output is 1 if and only if at least two of its inputs are Is. 

► 

► 



► 


3. Identify a problem that might occur ift 3th artificial neural network. 

4. To which stable configuration will the network in Figure 10.22 wander' if it is 
initialized with all its processing units inhibited? 


Questions 
& Exercises 


10.6 Robotics 

Robotics is the study of physical, autonomous agents that behave intelligently. As 
with all agents, robots must be able to perceive, reason, and act in their environment. 
Research in robotics thereby encompasses all areas of artificial intelligence as well as 
drawing heavily from mechanical and electrical engineering, 

Tb interact with the world, robots need mechanisms to manipulate objects and to 
move about. In the early days of robotics, the field was closely allied with the devel- 
opment of manipulators, most often mechanical arms with elbows, wrists, and hands 
or tools. Research dealt not only with how such devices could be maneuvered but 
also with how knowledge of their location and orientation could be maintained and 
applied. (You are able to close your eyes and still touch your nose with your finger 
because your brain maintains a record of where your nose and finger are.) Over time 
robots arms have become more dexterous to where, with a sense of touch based on 
force feedback, they can handle eggs and paper cups successfully. 
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Recently, the development of faster, lighter weight computers has lead to greater 
research in mobile robots that can move about. Achieving this mobility has led to an 
abundance of creative designs. Researchers in robot locomotion have developed robots 
that swim like fish, fly like dragonflies, hop like grasshoppers, and crawl like snakes. 

Wheeled robots are very popular since they are relatively easy to design and 
build, but they are limited in the type of terrain they can traverse. Overcoming this 
restriction, using combinations of wheels or tracks to climb stairs or roll over rocks, 
is the goal of current research. As an example, the NASA Mars rovers used specially 
designed wheels to move on rocky soil. 

Legged robots offer greater mobility but are significantly more complex. For 
instance, two-legged robots, designed to walk as humans, must constantly monitor 
and adjust their stance or they will fall. However, such difficulties can be overcome, 
as exemplified by the two-legged humanoidrobot named Asimo, developed by Honda, 
that can walk up stairs and even run. 

Despite great advances in manipulators and locomotion, most robots are still not 
very autonomous. Industrial robot arms are typically rigidly programmed for each 
task and work without sensors, assuming parts will be given to them in exact positions. 
Other mobile robots such as the NASA Mars rovers and military Unmanned Aerial 
Vehicles (UAVs) rely on human operators for their intelligence. 

Overcoming this dependency on humans is a major goal of current research. One 
question deals with what an autonomous robot needs to know about its environment 
and to what degree it needs to plan its actions in advance. One approach is to build 
robots that maintain detailed records of their environments, containing an inventory 
of objects and their locations with which they develop precise plans of action. Research 
in this direction depends heavily on progress in knowledge representation and stor- 
age as well as improved reasoning and plan-development techniques. 

An alternative approach is to develop reactive robots that, rather than maintaining 
complex records and expending great efforts in constructing detailed plans of action, 
merely apply simple rules for interacting with the world to guide their behavior 
moment by moment. Proponents of reactive robotics argue that when planning a long 
trip by car, humans do not make all-encompassing, detailed plans in advance. Instead, 
they merely select the major roads, leaving such details as where to eat, what exits to 
take, and how to handle detours for later consideration. Likewise, a reactive robot 
that needs to navigate a crowded hallway or to go from one building to another does 
not develop a highly detailed plan in advance, but instead applies simple rules to 
avoid each obstacle as it is encountered. This is the approach taken by the best-selling 
robot in history, the iRobot Roomba vacuum cleaner, which moves about a floor in a 
reactive mode without bothering to remember the details of furniture and other obsta- 
cles. After all, the family pet will probably not be in the same place next time. 

Of course, no single approach will likely prove the best for all situations. Truly 
autonomous robots will most likely use multiple levels of reasoning and planning, 
applying high-level techniques to set and achieve major goals and lower-level reactive 
systems to achieve minor sub-goals. An example of such multilevel reasoning is found 
in the Robocup competition-an international competition of robot soccer teams- 
that serves as a forum for research toward developing a team of robots that can beat 
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world-class human soccer teams by the year 2050. Here the emphasis is not just to 
build mobile robots that can "kick" a ball but to design a team of robots that cooper- 
ate with each other to obtain a common goal. These robots not only have to move and 
to reason about their actions, but they have to reason about the actions of their team- 
mates and their opponents. 

Another example of research in robotics is the field known as evolutionary robotics 
in which theories of evolution are applied to develop schemes for both low-level reac- 
tive rules and high-level reasoning. Here we find the survival-of-the-fittest theory 
being used to develop devices that over multiple generations acquire their own means 
of balance or mobility. Much of the research in this area distinguishes between a 
robot's internal control system (largely software) and the physical structure of its 
body. For example, the control system for a swimming tadpole robot was transferred 
to a similar robot with legs. Then evolutionary techniques were applied within the con- 
trol system to obtain a robot that crawled. In other instances, evolutionary techniques 
have been applied to a robot's physical body to discover positions for sensors that are 
optimal for performing a particular task. More challenging research seeks ways to 
evolve software control systems simultaneously with physical body structures. 

To list all the impressive results from research in robotics would be an over- 
whelming task. Our current robots are far from the powerful robots in fictional movies 
and novels, but they have achieved impressive successes on specific tasks. We have 
robots that can drive in traffic, behave like pet dogs, and guide weapons to their tar- 
gets. However, while relishing in these successes, we should note that the affection 
we feel for an artificial pet dog and the awesome power of smart weapons raise social 
and ethical questions that challenge society. Our future is what we make it. 


1. In what way does the reactive approach to robot behavior differ from the 
more traditional "plan based" behavior? 

2. what are some current topics of research in the field of robotics? 

3. What are two levels at vMcSk ttheof ies are beiflg applied to robot 

development? 


Question** 
& Exerciser; 


10.7 Considering the Consequences 

Without a doubt, advances being made in artificial intelligence have the potential of 
benefiting humankind, and it is easy to become caught up in the enthusiasm gener- 
ated by the potential benefits. However, there are also potential perils lurking in the 
future whose ramifications could be as devastating as their counterparts are benefi- 
cial. The distinction is often merely one's point of view or perhaps one's position in 
society-one person's gain might be another's loss. It is fitting then that we take a 
moment to look at advancing technology from alternative perspectives. 

Some view the advancement of technology as a gift to humanity-a means of 
freeing humans from boring, mundane tasks and opening the door to more enjoyable 
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lifestyles. But others see this same phenomenon as a curse that robs citizens of employ- 
ment and channels wealth toward those with power. This, in fact, was a message of the 
devoted humanitarian Mahatma Gandhi of India. He repeatedly argued that India 
would be better served by replacing large textile mills with spinning wheels placed in 
the homes of the peasants. In this way, he claimed, centralized mass production that 
employed only a few would be replaced by a distributed mass production system that 
would benefit multitudes. 

History is full of revolutions with roots in the disproportionate distribution of 
wealth and privilege. If today's advancing technology is allowed to entrench such dis- 
crepancies, catastrophic consequences could result. 

But the consequences ofbuilding increasingly intelligent machines is more sub- 
tle-more fundamental-than those dealing with power struggles between different 
segments of society. The issues strike at the very heart of humanity’s self-image. In 
the nineteenth century, society was appalled by Charles Darwin's theory of evolu- 
tion and the thought that humans might have evolved from lesser life forms. How 
then will society react if faced with the onslaught of machines whose mental capa- 
bilities challenge those ofhumans? 

In the past, technology has developed slowly, allowing time for our self-image to 
be preserved by readjusting our concept of intelligence. Our ancient ancestors would 
have interpreted the mechanical devices of the nineteenth century as having super- 
natural intelligence, but today we do not credit these machines with any intelligence 
at all. But how will humanity react if machines truly challenge the intelligence of 
humans, or, more likely, if the capabilities of machines begin to advance faster than 
our ability to adapt? 

We might get a clue to humanity's potential reaction to machines that challenge 
our intellect by considering society's response to IQ. tests in the middle of the twen- 
tieth century. These tests were considered to identify a child's level of intelligence. 
Children in the United States were often classified by their performances on these tests 
and channeled into educational programs accordingly. In turn, educational opportu- 
nities were opened to those children who performed well on these tests, whereas chil- 
dren who performed poorly were directed toward remedial programs of study. In 
short, when given a scale on which to measure an individual's intelligence, society 
tended to disregard the capabilities of those who found themselves on the lower end 
of the scale. How then would society handle the situation if the "intellectual" capa- 
bilities of machines became comparable, or even appeared to be comparable, with 
those ofhumans? Would society discard those whose abilities were seen as "inferior" 
to those of machines? If so, what would be the consequences for those members of 
society? Should a person's dignity be subject to how he or she compares to a machine? 

We have already begun to see the intellectual powers ofhumans challenged by 
machines in specific fields. Machines are now capable of beating experts in chess; 
computerized expert systems are capable of giving medical advice; and simple pro- 
grams managing investment portfolios often outperform investment professionals. 
How do such systems affect the self-image of the individuals involved? How will an 
individual's self-esteem be affected as that individual is outperformed by machines in 
more and more areas? 
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Many argue that the intelligence possessed by machines will always be inher- 
ently different from that of humans since humans are biological and machines are not. 
Thus, they argue, machines will never reproduce a human's decision-making process. 
Machines might reach the same decisions as humans but those decisions would not 
be made on the same basis as those made by humans. To what extent, then, are there 
different kinds of intelligence, and would it be ethical for society to follow paths pro- 
posed by nonhuman intelligence? 

In his book. Computer Power and Human Reason, Joseph Weizenbaum argues 
against the unchecked application of artificial intelligence as follows: 

Computers can make judicial decisions, computers can make psychiatric judgments. 
They can flip coins in much more sophisticated ways than can the most patient human 
being. The point is that they ought not be given such tasks. They might even be able 
to arrive at "correct" decisions in some cases — but always and necessarily on bases no 
human being should be willing to accept. 

There have been many debates on "Computers and Mind." What I conclude here 
is that the relevant issues are neither technological nor even mathematical; they are 
ethical. They cannot be settled by asking questions beginning with "can." The limits of 
the applicability of computers are ultimately statable only in terms of oughts. What 
emerges as the most elementary insight is that, since we do not now have any ways of 
making computers wise, we ought not now to give computers tasks that demand wisdom. 

You might argue that much of this section borders on science fiction rather than 
computer science. It was not too long ago, however, that many dismissed the question 
"What will happen if computers take over society?" with the same it-will-never-hap- 
pen attitude. But in many respects, that day has now arrived. If a computerized data- 
base erroneously reports that you have a bad credit rating, a criminal record, or an 
overdrawn checking account, is it the computer's statement or your claim of inno- 
cence that will prevail? If a malfunctioning navigational system indicates that a fog- 
covered runway is in the wrong place, where will the aircraft land? If a machine is used 
to predict the public's reaction to various political decisions, which decision does a 
politician make? How many times has a clerk been unable to help you because "the 
computer is down"? Who (or what), then, is in charge? Have we not already surren- 
dered society to machines? 


1. How much of today's population would survive if the machines developed Questions 

over the last 100 years were removed? What about the last 50 years? What & Exercises 

about 20 years? Where would the survivors be located? 

2. To what extent is your life controlled by machines? Who controls the 
machines that affect your life? 

3. Where do you get the information on which you base your daily decisions? 

What about your major decisions? What confidence do you have in the 
accuracy of that information? Why? 
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Chapter Review Problems 


(Asterisked problems are associated with optional sections.) 


?. As demonstrated in Section 10.2, humans 
might use a question for a purpose other than 
asking. Another example is "Do you know that 
your tire is flat?" which is used to inform 
rather than to ask. Give examples of questions 
used to reassure, to warn, and to criticize. 

2. Analyze a soda dispensing machine as an agent. 
What are its sensors? What are its actuators? 
What level of response (reflex, knowledge 
based, goal based) does it exhibit? 

3. Identify each of the following responses as 
being reflex, knowledge based, or goal based. 
Justify your answers. 

a. The light in a refrigerator turning on when 
the door is opened. 

b. A computer program translating text from 
German to English. 

c. A mountain climber planning a path to 
follow. 

4 if a researcher uses computer models for 

studying the memorization capabilities of the 
human mind, do the programs developed for 
the machine necessarily memorize to the best 
of the machine's abilities? Explain. 

5. Give some examples of declarative knowledge. 
Give some examples of procedural knowledge. 

c 6. In the context of object-oriented program- 
ming, what parts of an object are used to store 
declarative knowledge? What parts are used to 
store procedural knowledge? 

7. Which of the following activities do you expect 
to be performance oriented and which are 
simulation oriented? 

a. The design of a flight simulator 

b. The design of an automatic pilot system 

c. The design of a database dealing with 
library materials 

d. The design of a model of a nation's econ- 
omy for testing theories 


e. The design of a program for monitoring a 
patient's vital signs 

8. Today, many telephone calls to businesses are 
handled by automated answering systems that 
direct calls according to which option is 
selected by the caller. Do these systems pass 
the Turing test? Explain your answer. 

9. Identify a small set of geometric properties 
that can be used to distinguish between the 
symbols O, G, C, and Q, 

1 0. Describe the similarities between the tech- 
nique of identifying characteristics by compar- 
ing them to templates and the error-correcting 
codes discussed in Chapter 1 . 

1 1 . Describe two interpretations of the following 
line drawing based on whether the "corner" 
marked A is convex or concave: 


A 



12. Compare the roles of the prepositional phrases 
in the following two sentences (which differ 
by only one word). How could a machine be 
programmed to make such distinctions? 

The pigpen was built by the barn. 

The pigpen was built by the farmer. 

13. How do the results of parsing the following 
two sentences differ? How do the results of 
semantic analysis differ? 

Theodore rode the zebra. 

The zebra was ridden by Theodore. 

14. How do the results of parsing the following 
two sentences differ? How do the results of 
semantic analysis differ? 
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If X = 5 then add 1 to X else subtract 1 from X. 
IfX *5 then subtract 1 from X else add 1 to X. 

15. In the text we briefly discussed the problems 
of understanding natural languages as 
opposed to formal programming languages. As 
an example of the complexities involved in the 
case of natural languages, identify situations 
in which the question "Do you know what 
time it is?" has different meanings. 

16. Changes in the context of a sentence can 
change the significance of the sentence as 
well as its meaning. In the context of Figure 
10.4, how would the significance of the sen- 
tence "Mary hit John" change if the birth dates 
were in the 1960s? What if one were in the 
1960s and the other in the 1990s? 

17. Draw a semantic net representing the infor- 
mation in the following paragraph. 

Donna threw the ball to Jack, who hit it into 
center field. The center fielder tried to catch 
it, but it bounced off the wall instead. 

18 Sometimes the ability to answer a question 
depends as much on knowing the limits of 
knowledge as it does on the facts themselves. 
For example, suppose databases A and B both 
contain a complete list of employees who 
belong to the company's health insurance pro- 
gram, but only database A is aware that the list 
is complete. What could database A conclude 
about a member who was not on its list that 
database B could not? 

19. Give an example in which the closed-world 
assumption leads to a contradiction. 

2 0 Give two examples where the closed-world 
assumption is commonly used. 

21. In the context of a production system, what is 
the difference between a state graph and a 
search tree? 

22. Analyze the task of solving the Rubik's cube in 
terms of a production system. (What are the 
states, the productions, and so on?) 

23. a. Suppose a search tree is a binary tree and 

reaching the goal requires ten productions. 


What is the largest number of nodes that 
could be in the tree when the goal state is 
reached if the tree is constructed with a 
breadth-first manner? 

b. Explain how the total number of nodes con- 
sidered during the search could be reduced 
by conducting two searches at the same 
time- one beginning at the initial state while 
the other searches backward from the goal- 
until the two meet. (Assume that the search 
tree recording the states found in the back- 
ward search is also a binary tree and that 
both searches progress at the same rate.) 

24. In the text we mentioned that a production 
system is often used as a technique for draw- 
ing conclusions from known facts. The states 
of the system are the facts known to be true at 
each stage of the reasoning process, and the 
productions are the rules of logic for manipu- 
lating the known facts. Identify some rules of 
logic that allow the conclusion "John is tall" to 
be obtained from the facts that "John is a bas- 
ketball player," "Basketball players are not 
short," and "John is either short or tall." 

25 . The tree below represents possible moves in a 
competitive game, showing that player X cur- 
rently has a choice between move A and move 
B. Following the move of player X, player Y is 
allowed to select a move, and then player X is 
allowed to select the last move of the game. 
The leaf nodes of the tree are labeled W, L, or 
T depending on whether that ending repre- 
sents a win, loss, or tie for player X, Should 
player X select move A or move B? Why? How 
does selecting a "production" in a competitive 
atmosphere differ from a one-person game 
such as the eight-puzzle? 
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26. Analyze the game of checkers as a production 
system and describe a heuristic that could be 
used to determine which of two states is closer 
to the goal. How would the control system in 
this setting differ from that of a one-person 
game such as the eight-puzzle? 

27. By considering the manipulation rules of alge- 
bra as productions, problems involving the sim- 
plification of algebraic expressions can be 
solved in the context of a production system. 
Identify a set of algebraic productions that allow 
the equation 3/(2x + 1) =2/(2* - 2) to be 
reduced to the form x = 4. What are some rules 
of thumb (that is, heuristic rules) used when 
performing such algebraic simplifications? 

28. Draw the search tree that is generated by a 
breadth-first search in an attempt to solve the 
eight-puzzle from the following start state 
without using the assistance of any heuristic 
information. 



29. Draw the search tree that is generated by the 
algorithm of Figure 10.10 in an attempt to 
solve the eight-puzzle from the start state, in 
Problem 28 if the number of tiles out of place 
is used as a heuristic. 

3 0 Draw the search tree that is generated by the 
algorithm of Figure 10.10 in an attempt to 
solve the eight-puzzle from the following start 
state, assuming the heuristic used is the same 
as that developed in Section 10.3. 


1 

2 

3 

5 

7 

6 

4 


8 


3 1 . When solving the eight-puzzle, why would the 
number of tiles out of place not be as good a 
heuristic as the one used in Section 10.3? 


32 What is the distinction between the technique 
of deciding which half of the list to consider 
when performing a binary search (Section 5.5) 
and deciding which branch to pursue when 
performing a heuristic search? 

33. Note that if a state in the state graph of a pro- 
duction system has an extremely low heuristic 
value in comparison to the other states and if 
there is a production from that state to itself, 
the algorithm in Figure 10.10 can get caught in 
the loop of considering that State over and over 
again. Show that if the cost of executing any 
production in the system is at least one, then 
by computing the projected cost to be the sum 
of the heuristic value plus the cost of reaching 
the state along the path being traversed, this 
endless looping process will be avoided. 

34 What heuristic do you use when searching for a 
route between two cities on a large road map? 

35. List two properties that a heuristic should have 
if it is to be useful in a production system. 

36. Suppose you have two buckets. One has a 
capacity of exactly 3 liters; the other has a 
capacity of 5 liters. You can pour water from 
one bucket to another, empty a bucket, or fill a 
bucket at any time. Your problem is to place 
exactly 4 liters of water in the 5-liter bucket. 
Describe how this problem could be framed as 
a production system. 

37. Suppose your job is to supervise the loading of 
two trucks, each of which can carry at most 14 
tons. The cargo is a variety of crates whose 
total weight is 28 tons but whose individual 
weights vary from crate to crate. The weight of 
each crate is marked on its side. What heuris- 
tic would you use for dividing the crates 
between the two trucks? 

38. Which of the following are examples of meta- 
reasoning? 

a. He has not been gone long so he could not 
have gone far. 

b. Since I usually make the wrong decision 
and the last two decisions I made were cor- 
rect, 1 will reverse my next decision. 
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c. I am getting tired so I think I will take a nap. 

d. I am getting tired so I am probably not 
thinking clearly. 

39. Describe how a human's ability to solve the frame 
problem helps the human find lost articles. 

40. a. In what sense is learning by imitation simi- 

lar to learning by supervised training? 
b. In what sense is learning by imitation differ- 
ent from learning by supervised training? 

41. The following diagram represents an artificial 
neural network for an associative memory as 
discussed in Section 10.5. What pattern does it 
associate with any pattern in which only two 
units that are separated by a single unit are 
excited? What will happen if the network is 
initialized with all its units inhibited? 



42. The following diagram represents an artificial 
neural network for an associative memory as 
discussed in Section 10.5. What stable configu- 
ration does it associate with any initial pattern 
in which at least three of the units on the 
perimeter are excited and the center unit is 
inhibited? What would happen if it were given 
an initial pattern in which only two units that 
are opposite each other on the perimeter were 
excited? 



43. Design an artificial neural network for an 
associative memory (as discussed in Section 
10.5) consisting of a rectangular array of pro- 
cessing units that tries to move toward stable 
patterns in which a single vertical column of 
units is excited. 

44. Adjust the weights and threshold values in the 
artificial neural network in Figure 10.19 so 
that its output is 1 when both inputs are the 
same (both 0 or both 1) and 0 when the inputs 
are different (one being 0 while the other is 1). 

45. Draw a diagram similar to Figure 10.6 repre- 
senting the process of simplifying the alge- 
braic expression 7x + 3 = 3x - 5 to the 
expression x = -2. 

46. Expand your answer to the previous problem to 
show other paths that a control system might 
pursue when attempting to solve the problem. 

47. Draw a diagram similar to Figure 10.6 repre- 
senting the reasoning process involved when 
concluding that "Polly can fly" from the initial 
facts "Polly is a parrot," "A parrot is a bird," and 
"All birds can fly." 

48. In contrast to the statement in the preceding 
problem, some birds, such as an ostrich or a 
robin with a broken wing, cannot fly. However, 
it would not seem reasonable to construct a 
deductive reasoning system in which all the 
exceptions to the statement "All birds can fly" 
are explicitly listed. How then do we as 
humans decide whether a particular bird 

can or cannot fly? 

49. Explain how the meaning of the sentence "I 
read the new tax law" depends on the context. 

50. Describe how the problem of traveling from 
one city to another could be framed as a pro- 
duction system. What are the states? What are 
the productions? 

51. Suppose you must perform three tasks. A, B, 
and C, that can be performed in any order 
(but not simultaneously). Describe how this 
problem can be framed as a production system 
and draw its state graph. 
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52. How does the state graph in the previous prob- 
lem change if task C must be performed 
before task A? 

53 . a. If the notation (i, j), where i and; are posi- 

tive integers, is used to mean "if the entry 
in the ith position in the list is greater than 
the entry in fhe;'th position, interchange 
the two entries," which of the following two 
sequences does a better job of sorting a list 
of length three? 

(1,3) (3, 2) 

(1,2) (2, 3) (1,2) 

b. Note that by representing sequences of 

interchanges in this manner, sequences can 
be broken into sub-sequences that can then 
be reconnected to form new sequences. Use 
this approach to describe a genetic algorithm 


for developing a program that sorts lists of 
length ten. 

54. Suppose each member in a group of robots is 
to be equipped with a pair of sensors. Each 
sensor can detect an object directly in front of 
it within a range of two meters. Each robot is 
shaped like a round trash can and can move in 
any direction. Design a sequence of experi- 
ments to determine where the sensors should 
be placed to produce a robot that successfully 
pushes a basketball in a straight line. How 
does your sequence of experiments compare 
to an evolutionary system? 

55 , Do you tend to make decisions in a reactive or 
plan-based mode? Does you answer depend 
on whether you are deciding on what to have 
for lunch or making a career decision? 


Social Issues 


The following questions are intended as a guide to the ethical/social/legal issues asso- 
ciated with the field of computing. The goal is not merely to answer these questions. 
You should also consider why you answered as you did and whether your justifications 
are consistent from one question to the next. 

1 . To what extent should researchers in nuclear power, genetic engineering, and 
artificial intelligence be held responsible for the way the results of their work 
are used? Is a scientist responsible for the knowledge revealed by his or her 
research? What if the resulting knowledge was an unexpected consequence? 

2. How would you distinguish between intelligence and simulated intelligence? 
Do you believe there is a difference? 

3. Suppose a computerized medical expert system gains a reputation within the 
medical community for giving sound advice. To what extent should a physi- 
cian allow that system to alter his or her decisions regarding the treatment of 
patients? If the physician applies a treatment contrary to that proposed by the 
expert system and the system turns out to be right, is the physician guilty of 
malpractice? In general, if an expert system becomes well known within a 
field, to what degree could it hamper, rather than enhance, the ability of 
human experts when making their own judgments? 

4. Many would argue that a computer's actions are merely consequences of how 
it was programmed, and thus a computer cannot possess free will. In turn, a 
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computer should not be held responsible for its actions. Is a human's mind a 
computer? Are humans preprogrammed at birth? Are humans programmed 
by their environments? Are humans responsible for their actions? 

5. Are there avenues that science should not pursue even though it might be 
capable of doing so? For instance, if it becomes possible to construct a 
machine with perception and reasoning skills comparable to those of humans, 
would the construction of such a machine be appropriate? What issues could 
the existence of such a machine raise? What are some of the issues being 
raised today by advancements in other scientific fields? 

6 . History abounds with instances in which the work of scientists and artists was 
affected by the political, religious, or other social influences of their times. In 
what ways are such issues affecting current scientific efforts? What about 
computer science in particular? 

7. Many cultures today take at least some responsibility toward helping to retrain 
those whose jobs have been made redundant by advancing technology. What 
should/can society do as technology makes more and more of our capabilities 
redundant? 

8 . Suppose you receive a computer-generated bill for $0.00. What should you do? 
Suppose you do nothing and 30 days later you receive a second notice of 
$0.00 due in your account. What should you do? Suppose you do nothing and 
30 days later you receive another notice of $0.00 due in your account along 
with a note stating that, unless the bill is paid promptly, legal action will be 
taken. Who is in charge? 

9. Are there times when you associate personalities with your personal com- 
puter? Are there times when it seems vindictive or stubborn? Do you ever get 
mad at your computer? What is the difference between being mad at your 
computer and being mad as a result of your computer? Does your computer 
ever get mad at you? Do you have similar relationships with other objects 
such as cars, televisions, and ball-point pens? 

10. On the basis of your answers to Question 9, to what extent are humans will- 
ing to associate an entity's behavior with the presence of intelligence and 
awareness? Tb what extent should humans make such associations? Is it pos- 
sible for an intelligent entity to reveal its intelligence in some way other than 
its behavior? 

11. Many feel that the ability to pass the Turing test does not imply that a 
machine is intelligent. One argument is that intelligent behavior does not, in 
itself, imply intelligence. Yet the theory of evolution is based on the survival 
of the fittest, which is a behavior-based test. Does the theory of evolution 
imply that intelligent behavior is a predecessor to intelligence? Would the 
ability to pass the Turing test imply that machines were on their way to 
becoming intelligent? 

12. Medical treatment has advanced to the point that numerous parts of the 
human body can now be replaced with artificial parts or parts from human 
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donors. It is conceivable that this might someday include parts of the brain. 
What ethical problems would such capabilities raise? If a patient's neurons 
were replaced one at a time with artificial neurons, would the patient remairl 
the same person? Would the patient ever notice a difference? Would the 
patient remain human? 
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In this chapter we consider questions regarding what computers can and cannot do. We 
will see how simple machines, known as Turing machines, are used to identify the 
boundary between problems that are solvable by machines and problems that are not. 
We will identify a particular problem, known as the halting problem, whose solution falls 
beyond the powers of algorithmic systems and therefore beyond the capabilities of 
today's as well as tomorrow's computers. Moreover, we will find that even among the 
machine- solvable problems, there are problems whose solutions are so complex that they 
are unsolvable from any practical point of view. We close by considering how knowl- 
edge in the field of complexity can be used to construct a public-key encryption system. 


11.1 Functions and Their Computation 

Our goal in this chapter is to investigate the capabilities of computers. We want to under- 
stand what machines can and cannot do and what features are required for machines 
to reach their full potential. We begin with the concept of computing functions. 

A function in its mathematical sense is a correspondence between a collection 
of possible input values and a collection of output values so that each possible input 
is assigned a single output. An example is the function that converts measurements 
in yards into meters. With each measurement in yards, it assigns the value that would 
result if the same distance were measured in meters. Another example, which we 
could call the sort function, assigns each input list of numeric values to an output list 
whose entries are the same as those in the input list but are arranged in the order of 
increasing value. Still another example is the addition function whose inputs are pairs 
of values and whose outputs are values representing the sum of each input pair. 

The process of determining the particular output value that a function assigns to a 
given input is called computing the function. The ability to compute functions is important 
because it is by means of computing functions that we are able to solve problems. Tb 
solve an addition problem we must compute the addition function; to sort a list we must 
compute the sort function. In turn, a fundamental task of computer science is to find tech- 
niques for computing the functions that lie beneath the problems we want to solve. 


Recursive Function Theory 

Nothing tantalizes human nature more than to be told something cannot be done. 
Once researchers began to identify problems that are unsolvable in the sense that 
they have no algorithmic soludons, others began to study these problems to try to 
understand their complexity. Today, this field of research is a major part of the 
subject known as recursive function theory, and much has been learned about 
these super-difficult problems. Indeed, just as mathematicians have developed 
number systems that reveal "quantitative" levels beyond infinity, recursive func- 
rton theorists have uncovered multiple levels of complexity within problems that 
exist well beyond the capabilities of algorithms. 
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Consider, for example, a system in which a function's inputs and outputs can be 
predetermined and recorded in a table. Each time the output of the function is 
required, we merely look for the given input in the table where we find the required 
output. Thus the computation of the function is reduced to the process of searching 
the table. Such systems are convenient but limited in power because many functions 
cannot be represented completely in tabular form. An example is shown in Figure 11.1, 
which is an attempt to display the function that converts measurements in yards into 
equivalent measurements in meters. Because there is no limit to the list of possible 
input/output pairs, the table is destined to be incomplete. 

A more powerful approach to computing functions is to follow directions pro- 
vided by an algebraic formula rather than trying to display all possible input/output 
combinations in a table. We could, for example, use the algebraic formula 


V = P(1 + r)" 


to describe how to compute the value of an investment ofPafter earning an annually 
compounded interest rate of r for n years. 

But the expressive power of algebraic formulas has its limitations as well. There 
are functions whose input/output relationships are too complex to be described by 
algebraic manipulations. Examples include the trigonometric functions such as sine 
and cosine. If pressed to calculate the sine of 38 degrees, you might draw the appro- 
priate triangle, measure its sides, and calculate the desired ratio- a process that can- 
not be expressed in terms of algebraic manipulations of the value 38. Your pocket 
calculator also struggles with the task of computing the sine of 3 8 degrees. In reality, 
it is forced to apply rather sophisticated mathematical techniques to obtain a very 
good approximation to the sine of 38 degrees, which it reports to you as the answer. 

We see, then, that as we consider functions with increasing complexity, we are 
forced to apply more powerful techniques for computing them. Our question is 
whether we can always find a system for computing functions, regardless of their 
complexity. The answer is no. A striking result from mathematics is that there are 

Figure 1 1 . 1 An attempt to display trie (unction that converts measurements in yards into meters 
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functions that are so complex that there is no well-defined, step-by-step process for 
determining their outputs based on their input values. In turn, the computation of 
these functions lies beyond the abilities of any algorithmic system. These functions 
are said to be noncomputable, whereas the functions whose output values can be 
determined algorithmically from their input values are said to be computable. 

The distinction between computable and noncomputable functions is important 
in computer science. Because machines can only perform tasks described by algo- 
rithms, the study of computable functions is the study of the ultimate capabilities of 
machines. If we can identify capabilities that allow a machine to compute the entire 
set of computable functions and then build machines with these capabilities, we will 
be assured that the machines we build are as powerful as we can make them. Like- 
wise, if we discover that the solution to a problem requires the computation of a non- 
computable function, we can conclude that the solution to that problem lies beyond 
the capabilities of machines. 


Questions 
& Exercises 


1. Identify some functions that can be represented completely in tabular form. 

2. Identify some functions whose outputs can be described as an algebraic 
expression involving their inputs. 

3 . Identify a function that cannot be described in terms of an algebraic formula. 
Is your function nonetheless computable? 

4. Ancient Greek mathematicians used a straight-edge and compass to draw 
shapes. They developed techniques for finding the midpoint on a straight 
line, constructing a right angle, and drawing an equilateral triangle. 
However, what were some "computations" that their "computational 
system" could not perform? 


11.2 Turing Machines 

In an effort to understand capabilities and limitations of machines, many researchers 
have proposed and studied various computational devices. One of these is the Turing 
machine, which was proposed by Alan M. Turing in 1936 and is still used today as a 
tool for studying the power of algorithmic processes. 

Turing Machine Fundamentals 

A Turing machine consists of a control unit that can read and write symbols on a tape 
by means of a read/write head (Figure 11.2) . The tape extends indefinitely at both ends 
and is divided into cells, each of which can contain any one of a finite set of symbols. 
This set is called the machine’s alphabet. 
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Figure 11.2 The components of a Turing machine 
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At any time during a Turing machine's computation, the machine must be in one 
of a finite number of conditions, called states. A Turing machine's computation begins 
in a special state called the start state and ceases when the machine reaches another 
special state known as the halt state. 

A Turing machine's computation consists of a sequence of steps that are executed 
by the machine's control unit. Each step consists of observing the symbol in the current 
tape cell (the one viewed by the read- write head), writing a symbol in that cell, possi- 
bly moving the read- write head one cell to the left or right, and then changing states. 
The exact action to be performed is determined by a program that tells the control unit 
what to do based on the machine's state and the contents of the current tape cell. 

Let us consider an example of a specific Turing machine. For this purpose, we rep- 
resent the machine's tape as a horizontal strip divided into cells in which we can 
record symbols from the machine's alphabet. We indicate the current position of the 
machine's read/write head by placing a label under the current tape cell. The alpha- 
bet for our example consists of the symbols 0, 1, and *. The tape of our machine might 
appear as follows: 


L 

* 

1 

0 

i 

» 

\ 




Current 

position 


By interpreting a string of symbols on the tape as representing binary numbers 
separated by asterisks, we recognize that this particular tape contains the value 5. 
Our Turing machine is designed to increment such a value on the tape by 1 . More pre- 
cisely, it assumes that the starting position is at an asterisk marking the right end of 
a string of Os and Is, and it proceeds to alter the bit pattern to the left so that it rep- 
resents the next larger integer. 

The states for our machine are START, ADD, CARRY, OVERFLOW, RETURN, and 
HALT. The actions corresponding to each of these states and the content of the current 
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Figure 1 1 .3 A Turing machine for incrementing a value 
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cell are described in the table in Figure 1 1 . 3 . We assume that the machine always begins 
in the START state. 

Let us apply this machine to the tape pictured earlier, which contains the value 5. 
Observe that when in the START state with the current cell containing * (as is our case), 
we are instructed by the table to rewrite the *, move the mad/write head one cell to the 
left, and enter the ADD state. Having done this, the machine can be described as follows: 
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* 

\ 




Machine State = ADD Current 

position 

To proceed, we look at the table to see what to do when in the ADD state with the 
current cell containing 1 . The table tells us to replace the 1 in the current cell with 0, 
move the read/write head one cell to the left, and enter the CARRY state. Thus the con- 
figuration of the machine becomes: 


/ 

* 
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0 0 
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Machine State = CARRY Current 

position 


We again refer to the table to see what to do next and find that when in the CARRY 
state with the current cell containing 0, we should replace the 0 with I, move the 
read/write head one cell to the right, and enter the RETURN state. After we do this, 
the machine's configuration is as follows: 
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Machine State = RETURN Current 

position 

From this situation, the table instructs us to proceed by replacing the 0 in the 
current cell with another 0, move the read/write head one cell to the right, and remain 
in the RETURN state. Consequently, we find our machine in the following condition- 



Machine State = RETURN 


Current 

position 


At this point, we see that the table instructs us to rewrite the asterisk in the current 
cell and HALT. The machine thus stops in the following configuration (the symbols on 
the tape now represent the value 6 as desired): 



Machine State = HALT 


Current 

position 


The Church-Turing Thesis 

The Turing machine in the preceding example can be used to compute the function 
known as the successor function, which assigns each nonnegative integer input value 
n to the output value n + 1. We need merely place the input value in its binary form 
on the machine's tape, run the machine until it halts, and then read the output value 
from the tape. A function that can be computed in this manner by a Turing machine 
is said to be Turing computable. 

Turing's conjecture was that the Turing-computable functions were the same as the 
computable functions. In other words, he conjectured that the computational power 
of Turing machines encompasses that of any algorithmic system or, equivalently, that 
(in contrast to such approaches as tables and algebraic formulas) the Turing machine 
concept provides a context in which solutions to all the computable functions can be 
expressed. Today, this conjecture is often referred to as the Church-Turing thesis, in 
reference to the contributions made by both Alan Turing and Alonzo Church. Since 
Turing's initial work, much evidence has been collected to support this thesis, and 
today the Church-Turing thesis is widely accepted. That is, the computable functions 
and the Turing-computable functions are considered the same. 
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The Origins of Turing Machines 

Alan airing developed the concept of a Turing machine in the 1930s, well 
before technology was capable of providing the machines we know today. In 
fact, Turing's vision was that of a human performing computations with pencil 
and paper. Turing's goal was to provide a model by which the limits of "compu- 
tational processes" could be studied. This was shortly after the publication in 
1931 of Godel's famous paper exposing the limitations of computational sys- 
tems, and a major research effort was being directed toward understanding 
these limitations. In the same year that Turing presented his model (1936), 

Emil Post presented another model (now known as Post production systems) 
that has been shown to have the same capabilities as Turing's. As a testimony to 
the insights of these early researchers, their models of computational systems 
(such as Turing machines and Post production systems) still serve as valuable 
tools in computer science research. 


The significance of this conjecture is that it gives insight to the capabilities and 
limitations of computing machinery. More precisely, it establishes the capabilities of 
Turing machines as a standard to which the powers of other computational systems 
can be compared. If a computational system is capable of computing all the TUring- 
computable functions, it is considered to be as powerful as any computational system 
can be. 


Questions 
& Exercises 


I. Apply the Turing machine described in this section (Figure 11.3), starting 
with the following initial status: 
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Machine State = START Current 

position 

2. Describe a Turing machine that replaces a string of Os and Is with a single 0. 

3. Describe a Turing machine that decrements the value on the tape if it is 
greater than zero or leaves the value unaltered if it is zero. 

4 Identify an everyday situation in which calculating takes place. How is that 
situation analogous to a Turing machine? 

5. Describe a Turing machine that ultimately halts for some inputs but never 
halts for others. 


11.3 Universal Programming Languages 
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11.3 Universal Programming Languages 

In Chapter 6 we studied a variety of features found in high-level programming lan- 
guages. In this section we apply our knowledge of computability to determine which 
of these features are actually necessary. We will find that most features in today's 
high-level languages merely enhance convenience rather than contribute to the fun- 
damental power of the language. 

Our approach is to describe a simple imperative programming language that is rich 
enough to allow us to express programs for computing all the Turing-computable func- 
tions (and thus all the computable functions). Hence, if a future programmer finds that 
a problem cannot be solved using this language, the reason will not be a fault of the 
language. Instead, it will be that there is no algorithm for solving the problem. A pro- 
gramming language with this property is called a universal programming language. 

You might find it surprising that a universal language need not be complex. Indeed, 
the language we are about to present is quite simple. We will call it Bare Bones because 
it isolates the minimal set of requirements of a universal programming language. 

The Bare Bones Language 

Let us begin our presentation of Bare Bones by considering the declarative statements 
found in other programming languages. These statements allow programmers the 
luxury of thinking in terms of data structures and data types (such as arrays of numeric 
values and strings of alphabetic characters) even though the machine itself merely 
manipulates bit patterns without any knowledge of what the patterns represent. Before 
being presented to a machine for execution, a high-level instruction dealing with elab- 
orate data types and structures must be translated into machine-level instructions 
that manipulate bit patterns to simulate the actions requested. 

For convenience, we can interpret these patterns as numeric values represented 
in binary notation. Thus, all computations performed by a computer could be 
expressed as numeric computations involving nonnegative integers-it is all in the eye 
of the beholder. Moreover, programming languages could be simplified by requiring 
programmers to express algorithms in these terms (although this would place a larger 
burden on the programmer). 

Because our goal in developing Bare Bones is to develop the simplest language 
possible, we will follow this lead. All variables in Bare Bones will be considered to rep- 
resent bit patterns that, for convenience, we interpret as nonnegative integers in binary 
notation. Thus a variable currently assigned the pattern 10 will be said to contain the 
value two, whereas a variable assigned the pattern 101 will be said to contain five. 

Using this convention, all variables in a Bare Bones program are of the same type 
so the language does not need declarative statements by which variable names and 
their associated properties are described. When using Bare Bones, a programmer can 
simply begin using a new variable name when it is needed, with the understanding 
that it refers to a bit pattern interpreted as a nonnegative integer. 

Of course, a translator for our Bare Bones language must be able to distinguish vari- 
able names from the other terms. This is done by designing the syntax of Bare Bones so 
that the role of any term can be identified by syntax alone. For this purpose, we specify 
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that variable names must begin with a letter from the English alphabet, which can be fol- 
lowed by any combination of letters and digits (0 through 9). Thus the strings XYZ, B747, 
abcdef ghi, and X5Y can be used as variable names, whereas 2G5, %o, and x. y cannot. 

Let us now consider the procedural statements in Bare Bones. There are three 
assignment statements and one control structure representing a loop. The language 
is a free-format language, so each statement terminates with a semicolon, making it 
easy for a translator to separate statements that appear on the same line. We, however, 
will adopt the policy of writing only one statement peT line to enhance readability. 

Each of the three assignment statements requests that the contents of the vari- 
able identified in the statement be modified. The first allows us to associate the value 
zero with a variable. Its syntax is 

clear name; 

where name can be any variable name. 

The other assignment statements are essentially opposites of each other: 

incr name; 

and 

deer name; 

Again, name represents any variable name. The first of these statements causes the 
value associated with the identified variable to be incremented by one. Thus, if the 
variable Y were assigned the value five before the statement 

incr Y ; 

is executed, then the value assigned to Y afterward would be six. 

In contrast, the deer statement is used to decrement the value associated with 
the identified variable by one. An exception is when the variable is already associated 
with zero, in which case this statement leaves the value unaltered. Therefore, if the 
value associated with Y is five before the statement 

deer Y,- 

is executed, the value four would be associated with Y afterward. However, if the value 
of Y had been zero before executing the statement, the value would remain zero after 
execution. 

Bare Bones provides only one control structure represented by a while-end 
statement pair. The statement sequence 

while name not 0 do; 


end; 

(where name represents any variable name) causes any statement or statement 
sequence positioned between the whi le and end statements to be repeated as long as 
the value of the variable name is not zero, lb be more precise, when a while-end 
structure is encountered during program execution, the value of the identified variable 


11.3 Universal Programming Languages 511 


is first compared to zero. If it is zero, the structure is skipped, and execution contin- 
ues with the statement following the end statement. If, however, the variable's value 
is not zero, the statement sequence within the while-end structure is executed and 
control is returned to the while statement, whereupon the comparison is conducted 
again. Note that the burden of loop control is partially placed on the programmer, who 
must explicitly request that the variable's value be altered within the loop body to 
avoid an infinite loop. For instance, the sequence 

i n c r X ; 

while X not 0 do; 
in c r Z ; 

end; 

results in an infinite process because once the whi 1 e statement is reached, the value 
associated with X can never be zero, whereas the sequence 

clear Z ; 

while X not 0 do; 
in c r Z ; 
deer X; 

end ; 

ultimately terminates with the effect of transferring the value initially associated with 
X to the variable Z. 

Observe that while and end statements must appear in pairs with the while 
statement appearing first. However, a while-end statement pair might appear within 
the instructions being repeated by another while -end pair. In such a case the pairing 
of while and end statements is accomplished by scanning the program in its written 
form from beginning to end while associating each end statement with the nearest pre- 
ceding while statement not yet paired. Although not syntactically necessary, we 
often use indentation to enhance the readability of such structures. 

As a dosing example, the instruction sequence in Figure 11.4 results in the prod- 
uct of the values associated with X and Y being assigned to Z, although it has the side 

Figure 11.4 A Bare Bones program for computing XX Y 


clear Z ; 

while X not 0 do; 
clear W; 

while Y not 0 do; 
i n c r Z,- 
incr W; 
deer Y; 
end; 

while W not 0 do,- 
i ncr Y; 
deer W; 
end; 
deer X; 
end; 
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effect of destroying any nonzero value that might have been associated with X. (The 
while-end structure controlled by the variable W has the effect of restoring the orig- 
inal value ofY.) 

Programming in Bare Bones 

Keep in mind that our goal in presenting the language Bare Bones is to investigate 
what is possible, not what is practical. Bare Bones would prove to be awkward if used 
in an applied setting. On the other hand, we will soon see that this simple language 
fulfills our goal of providing a no-frills universal programming language. For now, we 
will merely demonstrate how Bare Bones can be used to express some elementary 
operations. 

We first note that with a combination of the assignment statements, any value (any 
nonnegative integer) can be associated with a given variable. For example, the fol- 
lowing sequence assigns the value three to the variable x by first assigning it the value 
zero and then incrementing its value three times: 

clear X ; 
incr X ; 
i n c r X ; 
incr X ; 

Another common activity in programs is to copy data from one location to another. 
In terms of Bare Bones, this means that we need to be able to assign the value of one 
variable to another variable. This can be accomplished by first clearing the destina- 
tion and then incrementing it an appropriate number of times. In fact, we have already 
observed that the sequence 

clear Z ; 

while X not 0 do; 
incr Z ; 
deer X; 
end; 

transfers the value associated with X to Z. However, this sequence has the side effect of 
destroying the original value of X. To correct for this, we can introduce an auxiliary 
variable to which we first transfer the subject value from its initial location. We then use 
this auxiliary variable as the data source from which we restore the original variable 
while placing the subject value in the desired destination. In this manner, the movement 
ofToday to Yesterday can be accomplished by the sequence shown in Figure 11.5. 

We adopt the syntax 

copy namel to name2; 

(where namel and name2 represent variable names) as a shorthand notation for 
a statement structure of the form in Figure 11.5. Thus, although Bare Bones itself 
does not have an explicit copy instruction, we often write programs as though it 
did, with the understanding that to convert such informal programs Into real Bare 
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Figure 11.5 A Bare Bones implementation of the instruction "copy Today to Tomorrow" 


clear Aux; 
clear Tomorrow; 
while Today not 0 do; 
incr Aux; 
deer Today; 
end; 

while Aux not 0 do; 
incr Today; 
incr Tomorrow; 
deer Aux; 
end; 


Bones programs, we must replace the copy statements with their equivalent w h i 1 e - 
end structures using an auxiliary variable whose name does not clash with a name 
already used elsewhere in the program. 

The Universality of Bare Bones 

Let us now apply the Church-Turing thesis to confirm our claim that Bare Bones is a 
universal programming language. First, we observe that any program written in Bare 
Bones can be thought of as directing the computation of a function. The function's 
input consists of values assigned to variables prior to executing the program, and the 
function's output consists of the values of variables when the program terminates. To 
compute the function, we merely execute the program, starting with proper variable 
assignments, and then observe the variables' values when the program terminates. 
Under these conditions the program 

incr X; 

directs the computation of the same function (the successor function) that is computed 
by the Turing machine example of Section 11.2. Indeed, it increases the value associ- 
ated with X by one. Likewise, if we interpret the variables X and Y as inputs and the 
variable Z as the output, the program 

copy Y to Z; 
while X not 0 do ; 
incr Z, 
deer X; 
end ; 

directs the computation of the addition function. 

Researchers have shown that the Bare Bones programming language can be used 
to express algorithms for computing all the Turing-computable functions. Combining this 
with the Church-Turing thesis implies that any computable function can be computed 
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by a program written in Bare Bones. Thus Bare Bones is a universal programming lan- 
guage in the sense that, if an algorithm exists for solving a problem, then that problem 
can be solved by some BaTe Bones program. In turn. Bare Bones could theoretically 
serve as a general-purpose programming language. 

We say theoretically because such a language is certainly not as convenient as the 
high-level languages introduced in Chapter 6. However, each of those languages essen- 
tially contains the features of Bare Bones as its core. It is, in fact, this core that ensures 
the universality of each of those languages; all the other features in the various lan- 
guages are included for convenience. 

Although not practical in an application programming environment, languages 
such as Bare Bones find use within theoretical computer science. For example, in 
Appendix E we use Bare Bones as a tool to settle the question regarding the equiva- 
lence of iterative and recursive structures raised in Chapter 5 . There we find that our 
suspicion of equivalence was, in fact, justified. 


Questions 
& Exercises 


1. Show that the statement invert X;; aietiioira ii& to convert tine' vail me' of 

X to zero if its initial value is nonzero and to 1 if its initial value is zero) can 
be simulated by a Bare Bones program segment. 

2. Show that even our simple Iltae inioi(estt3dtBmeints 

than necessary by showing that the clear statement can be replaced with 
combinations of other statements in the language. 

3. Show that the if-then- else struettura' cam simuiillat&dl unsingi Bare* Bettes. 
That is, write a program sequence in Bare Bones that simulates the action of 
the statement 

if X not 0 then SI else S2; 

where SI and S2 represent arbitrary statement sequences. 

4. Show that each of the Bare IBaites ^mteaffnents can be expressed in teriw& of 
the machine language of Appendix C. (Thus Bare Bones can be used as a 
programming language for such a machine.) 

5. How can negative numbers be dealt with in Bare Bones? 

6. Describe the function Bare Btones program, 

assuming the function's input is represented by X and its output by Z: 

Clear Z; 

while X not 0 do; 
incr Z; 
i n c r Z ; 
deer X; 
end; 
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11.4 A Noncomputable Function 

We now identify a function that is not Turing computable and so, by the Church- 
Turing thesis, is widely believed to be noncomputable in the general sense. Thus it is 
a function whose computation lies beyond the capabilities of computers. 

The Halting Problem 

The noncomputable function we are about to reveal is associated with a problem 
known as the halting problem, which (in an informal sense) is the problem of try- 
ing to predict in advance whether a program will terminate (or halt) if started under 
certain conditions. For example, consider the simple Bare Bones program 

while X not 0 do; 

i n c r X ; 
end; 

If we execute this program with the initial value ofX being zero, the loop will not be 
executed and the program’s execution will quickly terminate. However, if we execute 
the program with any other initial value of X, the loop will be executed forever, lead- 
ing to a nonterminating process. 

In this case, then, it is easy to conclude that the program's execution will halt 
only when it is started with X assigned the value zero. However, as we move to more 
complex examples, the task of predicting a program’s behavior becomes more com- 
plicated. In fact, in some cases the task is impossible, as we shall see. But first we 
need to formalize our terminology and focus our thoughts more precisely. 

Our example has shown that whether a program ultimately halts can depend on 
the initial values of its variables. Thus if we hope to predict whether a program's exe- 
cution will halt, we mustbe precise in regard to these initial values. The choice we are 
about to make for these values might seem strange to you at first, but do not despair. 
Our goal is to take advantage of a technique called self-reference-the idea of an object 
referring to itself. This ploy has repeatedly led to amazing results in mathematics from 
such informal curiosities as the sentence "This statement is false" to the more serious 
paradox represented by the question "Does the set of all sets contain itself?" What we 
are about to do, then, is set the stage for a line of reasoning similar to "If it does, then 
it doesn’t; but, if it doesn't, then it does." 

In our case self-reference will be achieved by assigning the variables in a pro- 
gram an initial value that represents the program itself. To this end, observe that each 
Bare Bones program can be encoded as a single long bit pattern in a one-character- 
per-byte format using ASCII, which can then be interpreted as the binary represen- 
tation for a (rather large) nonnegative integer. It is this integer value that we assign 
as the initial value for the variables in the program. 

Let us consider what would happen if we did this in the case of the simple program 

while X not 0 do; 

incr X ; 
end; 
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We want to know what would happen if we started this program with x assigned the 
integer value representing the program itself (Figure 11.6). In this case the answer is 
readily apparent. Because X would have a nonzero value, the program would become 
caught in the loop and never terminate. On the other hand, if we performed a simi- 
lar experiment with the program 

clear X ; 

while X not 0 do ; 
i n c r X ; 

end ; 

the program would terminate because the variable X would have the value zero by the 
time the while-end structure is reached regardless of its initial value. 

Let us, then, make the following definition: A Bare Bones program is self- 
terminating if executing the program with all its variables initialized to the pro- 
gram’s own encoded representation leads to a terminating process. Informally, a 
program is self-terminating if its execution terminates when started with itself as its 
input. Here, then, is the self-reference that we promised. 

Note that whether a program is self-terminating probably has nothing to do with 
the purpose for which the program was written. It is merely a property that each Bare 
Bones program either possesses or does not possess. That is, each Bare Bones pro- 
gram is either self-terminating or not. 

We can now describe the halting problem in a precise manner. It is the problem 
of determining whether Bare Bones programs are or are not self- terminating. We are 
about to see that there is no algorithm for answering this question in general. That is, 
there is no single algorithm that, when given any Bare Bones program, is capable of 
determining whether that program is or is not self-terminating. Thus the solution to 
the halting problem lies beyond the capabilities of computers. 

The fact that we have apparently solved the halting problem in our previous exam- 
ples and now claim that the halting problem Is unsolvable might sound contradictory, 
so let us pause for clarification. The observations we used in our examples were unique 
to those particular cases and would not be applicable in all situations. What the halting 

Figure 11.6 Testing a program for self-termination 


Encode the 
program as 

one long bit wh d ; 

pattern using 

ascii. 

0111011101101 000. ..0110010000111011 


1 

While X not 0 do; 

incr X; 
end; 


Assign this pattern to X 
and execute the program. 
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problem requests is a single, generic algorithm that can be applied to any Bare Bones 
program to determine whether it is self-terminating. Our ability to apply certain iso- 
lated insights to determine whether a particular program is self-terminating in no 
way implies the existence of a single, generic approach that can be applied in all 
cases. In short, we might be able to build a machine that can solve a particular halt- 
ing problem, but we cannot build a single machine that we could use to solve any 
halting problem that arises. 

The Unsolvability of the Halting Problem 

We now want to show that solving the halting problem lies beyond the capabilities of 
machines. Our approach is to show that to solve the problem would require an algo- 
rithm for computing a noncomputable function. The inputs of the function in ques- 
tion are encoded versions ofBare Bones programs; its outputs are limited to the values 
0 and 1. More precisely, we define the function so that an input representing a self- 
terminating program produces the output value 1 while an input representing a pro- 
gram that is not self-terminating produces the output value 0. For the sake of 
conciseness, we will refer to this function as the halting function. 

Our task is to show that the halting function is not computable. Our approach is the 
technique known as "proof by contradiction." In short, we prove that a statement is false 
by showing that it cannot be true. Let us, then, show that the statement "the halting func- 
tion is computable" cannot be true. Our entire argument is summarized in Figure 11.7. 

If the halting function is computable, then (because Bare Bones is a universal 
programming language) there must be a Bare Bones program that computes it. In 
other words, there is a Bare Bones program that terminates with its output equal to 1 
if its input is the encoded version of a self-terminating program and terminates with 
its output equal to 0 otherwise. 

lb apply this program we do not need to identify which variable is the input vari- 
able but instead merely to initialize all the program's variables to the encoded repre- 
sentation of the program to be tested. This is because a variable that is not an input 
variable is inherently a variable whose initial value does not affect the ultimate out- 
put value. We conclude that if the halting function is computable, then there is a Bare 
Bones program that terminates with its output equal to 1 if all its variables are ini- 
tialized to the encoded version of a self-terminating program and terminates with its 
output equal to 0 otherwise. 

Assuming that the program's output variable is named x (if it is not we could sim- 
ply rename the variables), we could modify the program by attaching the statements 

while X not 0 do; 
end; 

at its end, producing a new program. This new program must be either self-termi- 
nating or not. However, we are about to see that it can be neither. 

In particular, if this new program were self-terminating and we ran it with its 
variables initialized to the program's own encoded representation, then when its exe- 
cution reached the while statement that we added, the variable X would contain a 1 . 
(To this point the new program is identical to the original program that produced a 1 
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Figure 1 1 .7 Proving trie unsolvobility of the halting program 


First; Propose the existence 
of a program that, 

given any encoded 
version of a program 

i 


Then: It such a program exists, 
we could modify it by 



will halt with variable 
Xequal to 1 if the 
input represents a 
self-terminating 
program, or with X 
equal to 0 otherwise. 


However: If this new program were 
not self-terminating and 



Now: If this new program we 
self-terminating and 


execution would 
reach this point 
with X equal to 1 , 



we started it with 
its own encoding 
as its input 
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Proposed 

program 

while X 
not 0 do ; 
end; 


so execution 
would become 
trapped in this 
loop forever; 


i.e. , if the new program is 
self-terminating, then it 
is not self-terminating. 


we started it with 
its own encoding 

as its input, Consequently: 


execution would 
reach this point 
with X equal to 0, 



Proposed 

program 


while X 
not 0 def- 
end; 


so this loop 
would be skipped 


and execution 
would halt; 


The existence of 
the proposed 
program 



Proposed 

program 


would 
lead to 


the existence of 
a new program 


Proposed 

program 


while X 

not o do; 
end; 


that is neither 
self-terminating 
nor not self- 
terminating 


so the existence of the proposed 
program is impossible. 


i.e., if the new program 
is not self-terminating, 
then it is self-terminating 


if its input was the representation of a self-terminating program.) At this point, the pro- 
gram's execution would be caught forever in the while-end structure because we 
made no provisions for X to be decremented within the loop. But this contradicts our 
assumption that the new program is self-terminating. Therefore we must conclude that 
the new program is not self- terminating. 
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r£ however, the new program were not self-terminating and we executed it with 
its variables initialized to the program's own encoded representation, it would reach 
the added while statement with X being assigned the value 0. (This occurs because 
the statements preceding the while statement constitute the original program that 
produces an output of 0 when its input represents a program that is not self-termi- 
nating.) In this case, the loop in the while-end structure would be avoided and the 
program would halt. But this is the property of a self-terminating program, so we are 
forced to conclude that the new program is self-terminating, just as we were forced 
to conclude earlier that it is not self-terminating. 

In summary, we see that we have the impossible situation of a program that on 
the one hand must be either self-terminating or not and on the other hand can be nei- 
ther. Consequently, the assumption that led to this dilemma must be false. 

We conclude that the halting function is not computable, and because the solu- 
tion to the halting problem relies on the computation of that function we must con- 
clude that solving the halting problem lies beyond the capabilities of any algorithmic 
system. Such problems are called unsolvable problems. 

In closing, we should relate what we have just discussed to the ideas in Chapter 10. 
There, a major underlying question was whether the powers of computing machines 
include those required for intelligence itself. Recall that machines can solve only prob- 
lems with algorithmic solutions, and we have now found that there are problems with- 
out algorithmic solutions. The question, then, is whether the human mind embodies 
more than the execution of algorithmic processes. If it does not, then the limits we have 
identified here are also limits of human thought. Needless to say, this is a highly debat- 
able and sometimes emotional issue. If, for example, human minds are no more than 
programmed machines, then one would conclude that humans do not possess free will. 


1. Is the following Bare Bones program self-terminating? Explain your answer. 

incr X; 
deer Y ; 

2. Is the following Bare Bones program self-terminating? Explain your answer. 

copy X to Y; 
incr Y ; 
incr Y ; 

while X not 0 do; 
deer X; 
deer X; 
deer Y ; 
deer Y ; 
end; 

deer Y ; 

while Y not 0 do; 
end; 
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3 What is wrong with the following scenario? 

In a certain community, everyone owns his or her own house. The house 
painter of the community claims to paint all those and only those houses 
that are not painted by their owners. 

( Hint Who paints the house painter's house?) 


11.5 Complexity of Problems 

In Section 11.4 we investigated the solvability of problems. In this section we are inter- 
ested in the question of whether a solvable problem has a practical solution. We will 
find that some problems that are theoretically solvable are so complex that they are 
unsolvable from a practical point of view. 

Measuring a Problem's Complexity 

We begin by returning to our study of algorithm efficiency that we started in Section 
S.6. There we used big-theta notation to classify algorithms according to the time 
required to execute them. We found that the insertion sort algorithm is in the class 
0(n 2 ), the sequential search algorithm is in G(n), and the binary search algorithm is 
in 0(lg n). We now use this classification system to help us identify the complexity of 
problems. Our goal is to develop a classification system that tells us which problems 
are more complex than others and ultimately which problems are so complex that 
their solutions lie beyond practicality. 

The reason that our present study is based on our knowledge of algorithm effi- 
ciency is that we wish to measure the complexity of a problem in terms of the com- 
plexity of its solutions. We consider a simple problem to be one that has a simple 
solution; a complex problem is one that does not have a simple solution. Note that the 
fact that a problem has a difficult solution does not necessarily mean that the prob- 
lem itself is complex. After all, a problem has many solutions, one of which is bound 
to be complex. Thus to conclude that a problem itself is complex requires that we 
show that none of its solutions are simple. 

In computer science, the problems of interest are those that are solvable by 
machines. The solutions to these problems are formulated as algorithms. Thus the 
complexity of a problem is determined by the properties of the algorithms that solve 
that problem. More precisely, the complexity of the simplest algorithm for solving a 
problem is considered to be the complexity of the problem itself. 

But how do we measure the complexity of an algorithm? Unfortunately, the term 
complexity has different interpretations. One deals with the amount of decision mak- 
ing and branching involved in the algorithm. In this light, a complex algorithm would 
be one that involves a twisted, entwined set of directions. This interpretation might 
be compatible with the point of view of a software engineer who is interested in issues 
relating to algorithm discovery and representation, but it does not capture the concept 
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of complexity from a machine's point of view. A machine does not realty make deci- 
sions when selecting the next instruction for execution but merely follows its machine 
cycle over and over, each time executing the instruction that is indicated by the pro- 
gram counter. Consequently, a machine can execute a set of tangled instructions as 
easily as it can execute a list of instructions in a simple sequential order. This inter- 
pretation of complexity, therefore, tends to measure the difficulty encountered in an 
algorithm's representation rather than the complexity of the algorithm itself. 

An interpretation that more accurately reflects the complexity of an algorithm 
from a machine's point of view is to measure the number of steps that must be per- 
formed when executing the algorithm. Note that this is not the same as the number 
of instructions appearing in the written program. A loop whose body consists of a 
single statement but whose control requests the body's execution 100 times is equiv- 
alent to 100 statements when executed. Such a routine is therefore considered more 
complex than a list of 50 individually written statements, even though the latter 
appears longer in written form. The point is that this meaning of complexity is ulti- 
mately concerned with the time it takes a machine to execute a solution and not with 
the size of the program representing the solution. 

We therefore consider a problem to be complex if all its solutions require a lot of 
time. This definition of complexity is referred to as time complexity. We have already 
met the concept of time complexity indirectly through our study of algorithm efficiency 
in Section 5.6. After all, the study of an algorithm's efficiency is the study of the algo- 
rithm's time complexity-the two are merely inverses of each other. That is, "more effi- 
cient" equals "less complex." Thus, in terms of time complexity, the sequential search 
algorithm (which we found to be in 0(n)) is a more complex solution to the problem of 
searching a list than is the binary search algorithm (which we found to be in 0(lg n)). 

Let us now apply our knowledge of the complexity of algorithms to obtain a means 
of identifying the complexity of problems. We define the (time) complexity of a prob- 
lem to be 6(/[n}), where ftri) is some mathematical expression in n, if there is an algo- 
rithm for solving the problem whose time complexity is in 0{/(n)) and no other 
algorithm for solving the problem has a lower time complexity. That is, the (time) com- 
plexity of a problem is defined to be the (time) complexity of its best solution. Unfor- 
tunately, finding the best solution to a problem and knowing that it is the best is often 
a difficult problem in itself. In such situations, a variation of big-theta notation called 
big O notation (pronounced "big oh notation") is used to represent what is known 
about a problem's complexity. More precisely, if fin) is a mathematical expression in 
n and if a problem can be solved by an algorithm in 0(/(n)), then we say that the 
problem is in 0(f(n)) (pronounced "big oh oij\nJ). Thus, to say that a problem belongs 
to 0(/[u)) means that it has a solution whose complexity is in 0(/(n)) but it could pos- 
sibly have a better solution. 

Our investigation of searching and sorting algorithms tells us that the problem of 
searching within a list of length n (when all we know is that the list has previously 
been sorted) is in 0(lg n) because the binary search algorithm solves the problem. 
Moreover, researchers have shown that the searching problem is actually in 0(lg n) 
so the binary search represents an optimal solution for that problem. In contrast, we 
know that the problem of sorting a list of length n (when we know nothing about the 
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Figure 11,6 A procedure MergeLists for merging two lists 


procedure MergeLists (InputListA, InputListB, OutputList) 

if (both input lists are empty) then (Stop, with OutputList empty) 
if (InputListA is empty.) 

then (Declare it to be exhausted) 

else (Declare its first entry to be its current entry) 
if (InputListB is empty) 

then (Declare it to be exhausted} 

else (Declare its first entry to be its current entry) 
while (neither input list is exhausted) do 

(Put the "smaller" current entry in OutputList; 

if (that current entry is the last entry in its corresponding input list} 
then (Declare that input list to be exhausted) 

else (Declare the next entry in that input list to be the list's current entry) 

) 

Starting with the current entry in the input list that is not exhausted, 
copy the remaining entries to OutputList. 


original distribution of the values in it) is in 0(n 2 ) because the insertion sort algorithm 
solves the problem. The problem of sorting, however, is known to be in &(rt lg « ) , 
which tells us that the insertion sort algorithm is not an optimal solution (in the con- 
text of time complexity) . 

An example of a better solution to the sorting problem is the merge sort algo- 
rithm. Its approach is to merge small, sorted portions of the list to obtain larger sorted 
portions that can then be merged to obtain still larger sorted portions. Each merging 
process applies the merge algorithm that we encountered when discussing sequen- 
tial files (Figure 9.15). For convenience, we present it again in Figure 11.8, this time 
in the context of merging two lists. The complete (recursive) merge sort algorithm is 
presented as the procedure called MergeSort in Figure 11.9. When asked to sort a list, 
this procedure first checks to see if the list is shorter than two entries. If so, the pro- 
cedure's task is complete. If not, the procedure divides the list into two pieces, asks 
other copies of the procedure MergeSort to sort these pieces, and then merges these 
sorted pieces together to obtain the final sorted version of the list. 


Figure 11.9 The merge sort algorithm implemented as a procedure MergeSort 


procedure MergeSort (List) 
if (List has more than one entry} 

then (Apply the procedure MergeSort to sort the first half of List; 

Apply the procedure MergeSort to sort the second half of List; 
Apply the procedure MergeLists to merge the first and second 
halves of List to produce a sorted version of List 


) 
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To analyze the complexity of this algorithm, we first consider the number of com- 
parisons between list entries that must be made in merging a list of length r with a list 
oflength s. The merge process proceeds by repeatedly comparing an entry from one 
list with an entry from the other and placing the "smaller" of the two entries in the out- 
put list. Thus each time a comparison is made, the number of entries still to be con- 
sidered is reduced by one. Because there are only r + s entries to begin with, we 
conclude that the process of merging the two lists will involve no more than r + s 
comparisons. 

We now consider the entire merge sort algorithm. It attacks the task of sorting a 
list of length n in such a way that the initial sorting problem is reduced to two smaller 
problems, each of which is asked to sort a list oflength approximately n/2. These two 
problems are in turn reduced to a total of four problems of sorting lists of length 
approximately n/4. This division process can be summarized by the tree structure in 
Figure 11.10, where each node of the tree represents a single problem in the recursive 
process and the branches below a node represent the smaller problems derived from 
the parent. Hence, we can find the total number of comparisons that occur in the 
entire sorting process by adding together the number of comparisons that occur at the 
nodes in the tree. 

Let us first determine the number of comparisons made across each level of the 
tree. Observe that each node appearing across any level of the tree has the task of sort- 
ing a unique segment of the original list. This is accomplished by the merge process 
and therefore requires no more comparisons than there are entries in the list seg- 
ment, as we have already argued. Hence, each level of the tree requires no more com- 
parisons than the total number of entries in the list segments, and because the 
segments across a given level of the tree represent disjoint portions of the original list, 
this total is no greater than the length of the original list. Consequently, each level of 
the tree involves no more than n comparisons. (Of course the lowest level involves 
sorting lists oflength less than two, which involves no comparisons at all.) 


Figure 11.10 The hierarchy of problems generated by the merge sort algorithm 
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Space Complexity 

An alternative to measuring complexity in terms of time is to measure storage 
space requirements instead-resulting in a measure known as space complexity. 
That is, the space complexity of a problem is determined by the amount of storage 
space required to solve the problem. In the text we have seen that the time com- 
plexity of sorting a list with n entries is Ofn lg n). The space complexity of the 
same problem is no more than Ofn + 1 ) = Ofn). After all, sorting a list with n 
entries using the insertion sort requires space for the list itself plus space to store a 
single entry on a temporary basis. Thus, if we were asked to sort longer and longer 
lists, we would find that the time required for each task would increase more rap- 
idly than the space required. This is in fact a common phenomenon. Because it 
takes time to use space, a problem's space complexity never grows more rapidly 
than its time complexity. 

There are often tradeoffs made between time and space complexity. In 
some applications it might be advantageous to perform certain computations in 
advance and store the results in a table from which they can be retrieved quickly 
when needed. Such a "table lookup" technique decreases the time required to 
obtain a result once it is actually needed, at the expense of the additional space 
required by the table. On the other hand, data compression is often used to 
reduce storage requirements at the expense of the additional time required to 
compress and decompress the data. 


Now we determine the number of levels in the tree. For this, observe that the 
process of dividing problems into smaller problems continues until lists of length less 
than two are obtained. Thus the number of levels in the tree is determined by the 
number of times that, starting with the value n, we can repeatedly divide by two until 
the result is no larger than one, which is Ig n. More precisely, there are no more than 
fig nl levels of the tree that involve comparisons, where the notation Tig nl represents 
the value of lg n rounded up to the next integer. 

Finally, the total number of comparisons made by the merge sort algorithm when 
sorting a list of length n is obtained by multiplying the number of comparisons made 
at each level of the tree by the number of levels in which comparisons are made. We 
conclude that this is no larger than n Tig n\ Because the graph of n Tig nl has the same 
general shape as the graph of n lg n, we conclude that the merge sort algorithm belongs 
to Ofn lg 7i). Combining this with the fact that researchers tell us that the sorting prob- 
lem has complexity ®(n Ig n) implies that the merge sort algorithm represents an 
optimal solution to the sorting problem. 

Polynomial Versus Nonpolynomial Problems 

Suppose j\n) and g(n) are mathematical expressions. To say that gfn) is bounded by 
f(n) means that as we apply these expressions to larger and larger values of n, the 
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value offtn) will ultimately become greater than that of g(ri) and remain greater than 
g(n) for all larger values of n. In other words, thatg(n) is bounded by f[n) means that 
the graph of flji) will he above the graph of g(n) for "large" values of n. For instance, 
the expression lg n is bounded by the expression n (Figure 11.11a), and n Ig n is 
bounded by n (Figure 11.11b). 

We say that a problem is a polynomial problem if the problem is in 0(f(n)), 
where the expression/(n) is either a polynomial itself or bounded by a polynomial. The 
collection of all polynomial problems is represented by P. Note that our previous inves- 
tigations tell us that the problems of searching a list and of sorting a list belong to P. 

To say that a problem is a polynomial problem is a statement about the time 
required to solve the problem. We often say that a problem in P can be solved in poly- 
nomial time or that the problem has a polynomial time solution. 

Identifying the problems that belong to P is of major importance in computer sci- 
ence because it is closely related to questions regarding whether problems have prac- 
tical solutions. Indeed, problems that are outside the class P are characterized as 
having extremely long execution times, even for inputs of moderate size. Consider, for 
example, a problem whose solution requires 2" steps. The exponential expression 2" 
is not bounded by any polynomial-if jftn) is a polynomial, then as we increase the 
value of n, we will find that the values of 2" will ultimately be larger than those of fin). 
This means that an algorithm with complexity 0(2") will generally be less efficient, 
and thus require more time, than an algorithm with complexity 0(/(n)). An algorithm 
whose complexity is identified by an exponential expression is said to require expo- 
nential time. 

As a particular example, consider the problem of listing all possible subcommit- 
tees that can be formed from a group of n people. Because there are 2" - 1 such sub- 
committees (we allow a subcommittee to consist of the entire group but do not 
consider the empty set to be a subcommittee), any algorithm that solves this problem 
must have at least 2" - 1 steps and thus a complexity at least that large. But, the expres- 
sion 2” - 1, being an exponential expression, is not bounded by any polynomial. Hence 

Figure 1 ) . 1 1 Graphs of the mathematical expressions a Ig a n Ig n, and n 2 
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any solution to this problem becomes enormously time-consuming as the size of the 
group from which the committees are selected increases. 

In contrast to our subcommittee problem, whose complexity is large merely 
because of the size of its output, problems exist whose complexities are large even 
though their ultimate output is merely a simple yes or no answer. An example involves 
the ability to answer questions about the truth of statements involving the addition 
of real numbers. For instance, we can easily recognize that the answer to the question 
"Is it true that there is a real number that when added to itself produces the value 6?" 
is yes, whereas the answer to "Is it true that there is a nonzero real number which 
when added to itself is 0?" is no. However, as such questions become more involved, 
our ability to answer them begins to fade. If we found ourselves faced with many such 
questions, we might be tempted to turn to a computer program for assistance. Unfor- 
tunately, the ability to answer these questions has been shown to require exponen- 
tial time, so even a computer ultimately fails to produce answers in a timely manner 
as the questions become more involved. 

The fact that the problems that are theoretically solvable but are not in P have such 
enormous time complexities leads us to conclude that these problems are essentially 
unsolvable from a practical point of view. Computer scientists call these problems 
intractable. In turn, the class P has come to represent an important boundary that dis- 
tinguishes intractable problems from those that might have practical solutions. Thus an 
understanding of the class P has become an important pursuit within computer science. 


NP Problems 

Let us now consider the traveling salesman problem, which involves a traveling 
salesman who must visit each of his clients in different cities without exceeding his 
travel budget. His problem, then, is to find a path (starting from his home, connect- 
ing the cities involved, and returning to his home) whose total length does not exceed 
his allowed mileage. 

The traditional solution to this problem is to consider the potential paths in a sys- 
tematic manner, comparing the length of each path to the mileage limit until either 
an acceptable path is found or all possibilities have been considered. This approach, 
however, does not produce a polynomial time solution. As the number of cities 
increases, the number of paths to be tested grows more rapidly than any polynomial. 
Thus, solving the traveling salesman problem in this manner is impractical for cases 
involving large numbers of cities. 

We conclude that to solve the traveling salesman problem in a reasonable amount 
of time, we must find a faster algorithm. Our appetite is whetted by the observation 
that if a satisfactory path exists and we happen to select it first, our present algorithm 
terminates quickly. In particular, the following list of instructions can be executed 
quickly and has the potential of solving the problem: 

Pick one of the possible paths, and compute its total distance. 

If (this distance is not greater than the allowable mileage) 
then (declare a success) 
else (declare nothing) 
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In many cases, there is a fine line between a deterministic and a nondetermin- 
istic "algorithm." However, the distinction is quite clear and significant. A deter- 
ministic algorithm does not rely on the creative capabilities of the mechanism 
executing the algorithm, whereas a nondeterministic "algorithm" might. For 
instance, compare the instruction 

Go to the next intersection and turn either right or left, 

and the instruction 

Co to the next intersection and turn right or left depending on what the 
person standing on the corner tells you to do. 

In either case the action taken by the person following the directions is not deter- 
mined prior to actually executing the instruction. However, the first instruction 
requires the person following the directions to make a decision based on his or 
her own judgment and is therefore nondeterministic. The second instruction 
makes no such requirements of the person following the directions-the person is 
told what to do at each stage. If several different people follow the first instruc- 
tion, some might turn right, while others might turn left. If several people follow 
the second instruction and receive the same information, they wdl all turn in the 
same direction. Herein lies an important distinction between deterministic and 
nondeterministic "algorithms." If a deterministic algorithm is executed repeatedly 
with the same input data, the same actions will be performed each time. How- 
ever, a nondeterministic "algorithm" might produce different actions when 
repeated under identical conditions. 


However, this set of instructions is not an algorithm in the technical sense. Its first 
instruction is ambiguous in that it does not specify which path is to be selected nor 
does it specify how the decision is to be made. Instead it relies on the creativity of the 
mechanism executing the program to make the decision on its own. We say that such 
instructions are nondeterministic, and we call an "algorithm" containing such state- 
ments a nondeterministic algorithm. 

Note that as the number of cities increases, the time required to execute the pre- 
ceding nondeterministic algorithm grows relatively slowly. The process of selecting 
a path is merely that of producing a list of the cities, which can be done in a time pro- 
portional to the number of cities involved. Moreover, the time required to compute 
the total distance along the chosen path is also proportional to the number of cities 
to be visited, and the time required to compare this total to the mileage limit is inde- 
pendent of the number of cities. In turn, the time required to execute the nondeter- 
ministic algorithm is bounded by a polynomial. Thus it is possible to solve the traveling 
salesman problem by a nondeterministic algorithm in polynomial time. 

Of course, our nondeterministic solution is not totally satisfactory. It relies on a 
lucky guess. But its existence is enough to suggest that perhaps there is a deterministic 
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solution to the traveling salesman problem that runs in polynomial time. Whether or not 
this is true remains an open question. In fact, the traveling salesman problem is one of 
many problems that are known to have nondeterministic solutions that execute in poly- 
nomial time but for which no deterministic polynomial time solution has yet been found. 
The tantalizing efficiency of the nondeterministic solutions to these problems causes 
some to hope that efficient deterministic solutions will be found someday, yet most 
believe that these problems are just complex enough to escape the capabilities of effi- 
cient deterministic algorithms. 

A problem that can be solved in polynomial time by a nondeterministic algo- 
rithm is called a nondeterministic polynomial problem, or an NP problem for 

short. It is customary to denote the class of NP problems by NP. Note that all the prob- 
lems in P are also in NP, because any (deterministic) algorithm can have a nonde- 
terministic instruction added to it without affecting its performance. 

Whether all of the NP problems are also in P, however, is an open question, as 
demonstrated by the traveling salesman problem. This is perhaps the most widely 
known unsolved problem in computer science today. Its solution could have signifi- 
cant consequences. For example, in the next section we will learn that encryption 
systems have been designed whose integrity relies on the enormous time required to 
solve problems similar to the traveling salesman problem. If it turns out that efficient 
solutions to such problems exist, these encryption systems will be compromised. 

Efforts to resolve the question of whether the class NP is, in fact, the same as the class 
P have led to the discovery of a class of problems within the class NP known as the NP- 
complete problems. These problems have the property that a polynomial time solution 
for any one of them would provide a polynomial time solution for all the other problems 
in NP as well. That is, if a (deterministic) algorithm can be found that solves one of the 
NP-complete problems in polynomial time, then that algorithm can be extended to solve 
any other problem in NP in polynomial time. In turn, the class NP would be the same 
as the class P. The traveling salesman problem is an example of an NP-complete problem. 

In summary, we have found that problems can be classified as either solvable 
(having an algorithmic solution) or unsolvable (not having an algorithmic solution), as 
depicted in Figure 11.12. Moreover, within the class of solvable problems are two sub- 

Figure 11.12 A graphic summation of the problem classification 
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classes. One is the collection of polynomial problems that contains those problems 
with practical solutions. The second is the collection of nonpolynomial problems whose 
solutions are practical for only relatively small or carefully selected inputs. Finally, 
there are the mysterious NP problems that thus far have evaded precise classification. 


1. Suppose a problem can be solved by an algorithm in 6(2"), What eaniwe, coiir Question* 

elude about the complexity of the problem? & Exercise** 

2. Suppose a problem can be solved by an algorithm in 0 (tr) as wellLfcterBifocottiher 
algorithm in 0(2"). Will one algorithm always outperform the other? 

3. List all of the subcommittees that can be formed from a committee consisting 
of the two members Alice and Bill. List all the subcommittees that can be 
formed from the committee consisting of Alice, Bill, and Carol. What about 
the subcommittees from Alice, Bill, Carol, and David? 

4. Give an example of a polynomial problem. Give an example of a notipoly- 
nomial problem. Give an example of an NP problem that as yet has not been 
shown to be a polynomial problem. 

5. If the complexity of algorithmi X its igiteafteif thaw ldh&ttoIlali*orfftHiti Y, is algiotrithm 
X necessarily harder to understand than algorithm Y? Explain your answer. 


11.6 Public-Key Cryptography 

In some cases the fact that a problem is difficult to solve has been turned into an asset 
rather than a liability. Of particular interest is the problem of finding the factors of a 
given integer- a problem for which an efficient solution has yet to be found, if one 
even exists. For example, armed with only paper and pencil, you might find the task 
of finding the factors of relatively small values such as 2,173 to be time consuming, 
and if the number involved was so large that its representation required several hun- 
dred digits, the task would be intractable even if modern technology were applied 
using the best factoring techniques currently known. 

The failure to find an efficient way of determining the factors of large integers has 
long been a thorn in the side of many mathematicians, but in the field of cryptogra- 
phy it has been applied to produce a popular method of encrypting and decrypting 
messages. This method is known as the RSA algorithm-a name chosen to honor its 
inventors Ron Rivest, Adi Shamir, and Len Adleman. It is a means of encrypting mes- 
sages using one set of values known as the encrypting keys and decrypting those 
messages using another set of values known as the decrypting keys. People who 
know the encrypting keys can encrypt messages, but they cannot decrypt messages. 
The only person who can decrypt messages is the one holding the decrypting keys. 
Thus the encrypting keys can be widely distributed without violating the security 
of the system. 
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Such cryptography systems are called public-key encryption systems, a term that 
reflects the fact that the keys used to encrypt messages can be public knowledge with- 
out degrading the system's security. Indeed, the encrypting keys are often called the 
public keys, whereas the decrypting keys are called the private keys (Figure 11.13). 


Modular Notation 

To describe the RSA public-key encryption system, it is convenient to use the notation 
v (mod m ), which is read "x modulo m" or usually just "x mod m," to represent the remain- 
der obtained when the value x is divided by m. Thus 9 (mod 7) is 2 because 9+7 pro- 
duces a remainder of 2. Similarly, 24 (mod 7) is 3 because 2 4-7 produces a remainder 
of 3, and 14 (mod 7) is 0 because 14*7 produces a remainder of 0. Note that A: (mod rri) 
is x itself if x is an integer in the range 0 to m - 1. For example, 4 (mod 9) is 4. 

Mathematics tells us that if p and q are prime numbers and m is an integer 
between 0 and pq (the product of p and q) then 

1 = m * 0 >-i)(</-i) (modpg) 

for any positive integer It. Although we will not justify this claim here, it is advanta- 
geous to consider an example to clarify the statement. Suppose, then, that p and q 
are the prime numbers 3 and 5, respectively, and m is the integer 4. Then the state- 
ment claims that for any positive integer k, the value ,7 A - 1 )('/-•) divided by 15 (the 
product of 3 and 5) will produce the remainder 1. In particular, if* = 1, then 

, m *CP- )(7- !) . 4 i ( 3 - i ) ( s - i ) 48 _ 65,536 

Figure 11.13 Public key cryptography 
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which when divided by 15 produces the remainder I as claimed. Moreover, if He = 2, then 

m k ( _ 4 2(3-i)(5-t) _ 4 16 _ 4 A 94,967,296 

which when divided by 15 again produces the remainder 1. Indeed, we would obtain 
the remainder 1 regardless of the positive integer chosen for it 


RSA Public-Key Cryptography 

We are now prepared to construct and analyze a public-key encryption system based 
on the RSA algorithm. First we pick two distinct prime numbers;; and q, whose prod- 
uct we will represent by n. Then we pick two other positive integers e and d such that 
e X d - k(p - 1 )(q - 1) + 1, for some positive integer k. We are calling these values e 
and d because they will be part of the encryption and decryption process, respec- 
tively. (The fact that values e and A can be chosen to satisfy the preceding equation 
is another fact from mathematics that we will not pursue here.) 

Thus we have selected five values: p, q, n, e, and d. The values e and n are the 
encrypting keys. The values d and n are decrypting keys. The values p and q are only 
used for constructing the encryption system. 

Let us consider a specific example for clarification. Suppose we choose 7 and 13 as t h e 
values for;; and q. Then n - 7X13 -91. Moreover, the values 5 and 29 could be used 
fore and d because 5 X 2<A = 145 = 144 +1=2(7- 1)03- 1) + 1 = 2(p - l)(c/- 1) 
+ 1 as required. Thus, the encrypting keys are n = 91 and e = 5, and the decrypting 
keys are n - 91 and d - 29. Wc distribute the encrypting keys to anyone who might 
want to send us messages, but we keep the decrypting keys (as well as the values of 
p and q) to ourselves. 

We now consider how messages are encrypted. To this end, suppose a message 
is currently encoded as a bit pattern (perhaps using ASCII or Unicode) and the value 
of the pattern, when interpreted as a binary representation, is less than n. (If it is not 
less than n, we would chop the message into smaller segments and encrypt each seg- 
ment individually.) 

Let us assume that our message, when interpreted as a binary representation, 
represents the value m. Then, the encrypted version of the message is the binary rep- 
resentation of the value c = m °(mod n). That is, the encrypted message is the binary 
representation of the remainder obtained by dividing m " by n. 

In particular, if someone wanted to encrypt the message 10111 using the encrypting 
keys 72 = 9] and e = 5 as developed in the previous example, he or she would first rec- 
ognize that 10111 is the binary representation for 23, then compute 23 c = 23 5 = 
6,436,343, and finally divide this value by n - 91 to obtain the remainder 4. T h e 
encrypted version of the message would therefore be 100, which is the binary repre- 
sentation of 4. 

To decrypt a message that represents the value c in binary notation, wc compute 
the value <? (mod n). That is, we compute the value d!, divide the result by n, and 
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retain the remainder. Indeed, this remainder will be the value m of the original mes- 
sage because 

c * (mod 11) = m e x d (mod ri ) 

. rrflp-iyifi) + i ( m od n'j 
= m x m A -"'-'( m o d r/) 

= m (mod ri) 

= m 

Here we have used the facts that m k A X* M1 » (mod n) = m*<P J 1 (modpr,) = 1 and 
that wi (mod ri) = m (because m < ri), as previously claimed. 

Continuing with the preceding example, if we received the message 100, we would 
recognize this as the value 4, compute the value A” - 4" - 288,230,376,151,711,744, 
and divide this value by n - 91 to obtain the remainder 23, which produces the orig- 
inal message 10111 when expressed in binary notation. 

In summary, an RSA public-key encryption system is generated by selecting 
two prime integers, p and q, from which the values n, e, and d are generated. The 
values n and e arc used to encrypt messages and are therefore the public keys. The 
values n and d are used to decrypt messages and are the private keys (Figure 11 . 14 ). 
The beauty of the system is that knowing how to encrypt messages does not allow 
one to decrypt messages. Thus the encrypting keys n and e can be widely distributed. 
If your adversaries were to obtain these keys, they would still not be able to decrypt 
the messages they intercept. Only a person who knows the decrypting keys can 
decrypt messages. 


Figure 11.14 Establishing an RSA public key encryption system 
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The security of this system is based on the assumption that knowing the encrypting 
keys n and e does not allow one to compute the decrypting keys n and d. However, 
there are algorithms for doing exactly that! One approach would be to factor the value 
n to discover the values p and q, and then to determine d by finding a value k such 
that k(p - \)fq - 1) + 1 is evenly divided by e (the quotient would then be d). On the 
other hand, the first step in this process can be time-consuming-especially if the val- 
ues of p and q were chosen to be large. In fact, if p and q are so large that their binary 
representations require hundreds of digits, then the best known factoring algorithms 
would require years before the identities ofp and q could be revealed from n. In turn, 
the content of an encrypted message would remain secure long after its significance 
had deteriorated. 

To this date, no one has found an efficient way of decrypting messages based on RSA 
cryptography without knowing the decrypting keys, and thus public-key encryption 
based on the RSA algorithm is widely used to obtain privacy when communicating over 
the Internet. 


1. Find the factors of 66,043. (Don't waste too much time on this one. The point Questions 

is that it can be time-consuming.) fa EXGTCiSG*» 

2. Using the public keys n = 91 and e = 5, encrypt the message 101. 

3. Using the private' feey $ ti = 91 and d = 29, decrypt the message 10. 

4. Find the appropriate valka 4 to tlte’dbar^ptih^lktys n and d in an RSA public- 
key cryptography system based on the primes p = 7 and q = 19 and the 
encryption key e = 5. 
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i. Show how a structure of the form 


3 . Write a Bare Bones program that places the 
Xth power of 2 in the variable Z. 


while X equals 0 do,- 


end; 


4. In each of the following cases write a program 
sequence in Bare Bones that performs the 
indicated activity: 

a. Assign 0 to Z if the value ofX is even; oth- 


2 . Write a Bare Bones program that places a 1 in 
the variable Z if the variable X is less than or 
equal to the variable Y, and places a 0 in the 
variable Z otherwise. 


can be simulated with Bare Bones. 


erwise assign 1 to Z. 

b. Calculate the sum of the integers from 0 


to x. 


5. Write a Bare Bones routine that divides the 
value of X by the value of Y. Disregard any 
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remainder; that is, 1 divided by 2 produces 0, 
and 5 divided by 3 produces 1 . 

6. Describe the function computed by the follow- 
ing Bare Bones program, assuming the func- 
tion's inputs are represented by X and Y and 
its output by Z: 

copy x to Z; 
copy Y to Aux; 
while Aux not 0 do; 
deer Z; 
deer Aux; 
end; 

7. Describe the function computed by the follow- 
ing Bare Bones program, assuming the func- 
tion's inputs are represented by X and Y and 
its output by 2 : 

clear Z ; 
copy X to Auxl; 
copy Y to Aux2; 
while Auxl not 0 do; 
while Aux2 not 0 do; 
deer Z; 
deer Aux2; 
end; 

deer Auxl; 
end; 

8. Write a Bare Bones program that computes the 
exclusive or of the variables X and Y, leaving 
the result in the variable Z. You might assume 
that X and Y start only with integer values of 0 
and 1. 

9. Show that if we allow instructions in a Bare 
Bones program to be labeled with integer val- 
ues and replace the while loop structure with 
the conditional branch represented by the form 

if name not 0 goto label; 

where name is any variable and label is an 
integer value used elsewhere to label an 
instruction, then the new language will still be 
a universal programming language. 

1 0. In this chapter we saw how the statement 


copy namel to name2; 

could be simulated in Bare Bones. Show how 
that statement could still be simulated if the 
while loop structure in Bare Bones were 
replaced with a posttest loop expressed in 
the form 

repeat . . . until (name equals 0} 

1 1 . Show that the Bare Bones language would 
remain a universal language if the while 
statement were replaced with a posttest loop 
expressed in the form 

repeat . . . until (name equals 0) 

12. Design a Turing machine that once Started will 
use no more than a single cell on its tape but 
will never reach its halt state. 

13. Design a Tiring machine that places Os in all 
the cells to the left of the current cell until it 
reaches a cell containing an asterisk. 

14. Suppose a pattern of Os and Is on the tape 
of a Turing machine is delimited by asterisks 
at either end. Design a Turing machine 

that rotates this pattern one cell to the left, 
assuming that the machine starts with the 
current cell being the asterisk at the right 
end of the pattern. 

15. Design a Turing machine that reverses the pat- 
tern of Os and Is that it finds between the cur- 
rent cell (which contains an asterisk) and the 
first asterisk to the left. 

16. Summarize the Church-Turing thesis. 

17. Is the following Bare Bones program self- 
terminating? Explain your answer. 

copy X to Y; 
incr Y ; 
incr Y ; 

while X not 0 do; 
deer X; 
deer X; 
deer Y ; 
deer Y ; 
end; 
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deer Y ; 

while Y not 0 do; 

incr X; 
deer Y ; 
end; 

while X not 0 do; 

end; 

18. Is the following Bare Bones program self- 
terminating? Explain your answer. 

while X not 0 do; 

end; 

19. Is the following Bare Bones program self- 
terminating? Explain your answer. 

while X not 0 do; 

deer X; 
end; 

20. Analyze the validity of the following pair of 
statements: 

The next statement is true. 

The previous statement is false. 

21 . Analyze the validity of the statement "The 
cook on a ship cooks for all those and only 
those who do not cook for themselves." (Who 
cooks for the cook?) 

22. Suppose you were in a country where each 
person was either a truth teller or a liar. (A 
truth teller always tells the truth, a liar always 
lies.) What single question could you ask a 
person that would allow you to detect whether 
that person was a truth teller or a liar? 

23. Summarize the significance of Turing 
machines in the field of theoretical computer 
science. 

24. Summarize the significance of the halting 
problem in the field of theoretical computer 
science. 

25. Suppose you needed to find out if anyone in a 
group of people had a birthday on a particular 
date. One approach would be to ask the mem- 
bers one at a time. If you took this approach, 
the occurrence of what event would tell you 


that there was such a person? What event 
would tell you that there was no such person? 
Now suppose that you wanted to find out if at 
least one of the positive integers has a particu- 
lar property and you applied the same 
approach of systematically testing the integers 
one at a time. If, in fact, some integer has the 
property, how would you find out? If, how- 
ever, no integer has the property, how would 
you find out? Is the task of testing to see if a 
conjecture is true necessarily symmetric with 
the task of testing to see if it is false? 

26. Is the problem of searching through a list for a 
particular value a polynomial problem? Justify 
your answer. 

27. Design an algorithm for deciding whether a 
given positive integer is prime. Is your solu- 
tion efficient? Is your solution a polynomial or 
nonpolynomial one? 

28. Is a polynomial solution to a problem always 
better than an exponential solution? Explain 
your answer. 

29. Does the fact that a problem has a polynomial 
solution mean that it can always be solved in 
a practical amount of time? Explain your 
answer. 

30. Charlie Programmer is given the problem of 
dividing a group (of an even number of peo- 
ple) into two disjoint subgroups of equal size 
so that the difference between the total ages of 
each subgroup is as large as possible. He pro- 
poses the solution of forming all possible sub- 
group pairs, computing the difference 
between the age totals of each pair, and select- 
ing the pair with the largest difference. Mary 
Programmer, on the other hand, proposes that 
the original group first be sorted by age and 
then divided into two subgroups by forming 
one subgroup from the younger half of the 
sorted group and the other from the older half. 
What is the complexity of each of these solu- 
tions? Is the problem itself of polynomial, NP, 
or nonpolynomial complexity? 
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3 1 . Why is the approach of generating all possible 
arrangements of a list and then picking the 
one with the desired arrangement not a satis- 
factory way to sort a list? 

32 . Suppose a lottery is based on correctly picking 
four integer values, each in the range from 1 
W 50. Moreover, suppose that the jackpot 
grows so large that it becomes profitable to 
buy a separate lottery ticket for each possible 
combination. If it takes one second to buy a 
single ticket, how long would it take to buy 
one ticket for each combination? How would 
the time requirement change if the lottery 
required picking five numbers instead of four? 
What does this problem have to do with the 
material from this chapter? 

33 . Is the following algorithm deterministic? 
Explain your answer. 

procedure mystery (Number) 
if (Number > 5) 
then (answer "yes") 
else (pick a value less than 5 and 

give this number as the answer) 

34 . Is the following algorithm deterministic? 
Explain your answer. 

Drive straight ahead. 

At the third intersection, ask the person standing 
on the corner if you should turn right or left. 
Turn according to that person's directions. 

Drive two more blocks and stop there. 

35 . Identify the points of nondeterminism in the 
following algorithm: 

Select three numbers between 1 and 100. 
if (the sum of the selected numbers is greater 
than 1 50) 

then (answer "yes") 

else (select one of the chosen numbers and 
give that number as the answer) 

36 . Does the following algorithm have a polyno- 
mial or nonpolynomial time complexity? 
Explain your answer. 


procedure mystery (ListOfN umbers) 

Pick a collection of numbers from 
ListOfNumbers. 

if (the numbers in that collection add to 1 25) 
then (answer "yes") 
else {do not give an answer) 

37 . Which of the following problems are in the 
class P? 

a. A problem with complexity >r 

b. A problem with complexity 3n 

c. A problem with complexity n 2 + 2n 

d. A problem with complexity tti 

38 . Summarize the distinction between stating that a 
problem is a polynomial problem and stating 
that it is a nondeterministic polynomial problem. 

39 . Give an example of a problem that is in both 
the class P and the class NP. 

40 . Suppose you are given two algorithms for solv- 
ing the same problem. One algorithm has time 
complexity n 4 and the other has time com- 
plexity 4m For what size inputs is the former 
more efficient than the latter? 

4 1 . Suppose we were faced with solving the trav- 
eling salesman problem in a context involving 
15 cities in which any two cities were con- 
nected by a unique road. How many different 
paths through the cities would there be? How 
long would it take to compute the length of all 
of these paths assuming that the length of a 
path can be computed in one microsecond? 

42 . How many comparisons between names are 
made if the merge sort algorithm (Figures 111) 
and 11.8) is applied to the list Alice, Boh, 

Carol, and David? How many arc required if 
the list is Alice, Bob, Carol, David, and Elaine? 

43 . Give an example of a problem in each of the 
categories represented in Figure 11.12. 

44 . Design an algorithm for finding integer solutions 
for equations of the form A- 2 + if = n, where u is 
some given positive integer. Determine the time 
complexity of your algorithm. 
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45. Another problem that falls in the NP-complete 
category is the knapsack problem, which is 
the problem of finding which numbers from a 
list are the ones whose sum is a particular 
value. For example, the numbers 257, 388, and 
782 are the entries in the list 

642 257 771 388 391 782 304 

whose sum is 1427. Find the entries whose 
sum is 1723. What algorithm did you apply? 
What is the complexity of that algorithm? 

46. Identify similarities between the traveling 
salesman problem and the knapsack problem 
(see Problem 45). 

47. The following algorithm for sorting a list is 
called the bubble sort. How many compar- 
isons between list entries does the bubble sort 
require when applied to a list of n entries? 

procedure 8ubbleSort (List) 

Counter <- 1 ; 

while (Counter < number of entries in List) do 
[N e- the number of entries in List; 
while (N > 1) do 

(if (the Nth List entry is less than the 
entry preceding it) 
then (interchange the Nth entry 
with the preceding entry); 

N « - N - 1 

) 

i 


48. Use RSA public-key encryption to encrypt the 
message 110 using the public keys n = 91 and 
e = 5. 

49. Use RSA public-key encryption to decrypt the 
message 111 using the private keys n = 133 
and <7=5. 

50. Suppose you know that the public keys to a 
public-key encryption system based on the 
RSA algorithm are n = 77 and e = 7. What 
are the private keys? What allows you to 
solve this problem in a reasonable amount 
of time? 

51 . Find the factors of 107,531. I low does this 
problem relate to this chapter? 

52. What can be concluded if the positive integer 
n has no integer factors in the range from 2 to 
the square root of n? What does this tell you 
about the task of finding the factors of a posi- 
tive integer? 


Social Issues 

The following questions are intended as a guide to the ethical/social/legal issues asso- 
ciated with the field of computing. The goal is not merely to answer these questions. 
You should also consider why you answered as you did and whether your justifications 
are consistent from one question to the next. 

1 . Suppose the best algorithm for solving a problem would require 100 years to 
execute. Would you consider the problem to be tractable? Why? 

2. Should citizens have the right to encrypt messages in such a manner that 
precludes monitoring from government agencies? Does your answer 
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provide for "proper" law enforcement? Who should decide what "proper" law 
enforcement is? 

3 If the human mind is an algorithmic device, what consequences does Turing's 
thesis have in regard to humanity? To what extent do you believe that Turing 
machines encompass the computational abilities of the human mind? 

4. We have seen that there are different computational models (finite tables, 
algebraic formulae, Turing machines, etc.) having different computational 
abilities. Are there differences in the computational capabilities of different 
organisms? Are there differences in the computational capabilities of different 
humans? If so, should humans with higher abilities be able to use those abili- 
ties to obtain higher lifestyles? 

5 . Today there are websites that provide road maps of most cities. These sites 
assist in finding particular addresses and provide zooming capabilities for 
viewing the layout of small neighborhoods. Starting with this reality, consider 
the following fictitious sequence. Suppose these map sites were enhanced 
with satellite photographs with similar zooming capabilities. Suppose these 
zooming capabilities were increased to give a more detailed image of individ- 
ual buildings and the surrounding landscape. Suppose these images were 
enhanced to include real-time video. Suppose these video images were 
enhanced with infrared technology. At this point others could watch you 
inside your own home 24 hours a day. At what point in this progression were 
your privacy rights first violated? At what point in this progression do you 
think we moved beyond the capabilities of current spy-satellite technology? 
To what degree is this scenario fictitious? 

6 . Suppose a company develops and patents an encryption system. Should the 
national government of the company have the right to use the system as it 
sees fit in the name of national security? Should the national government of 
the company have the right to restrict the company's commercial use of the 
system in the name of national security? What if the company is a multina- 
tional organization? 

7. Suppose you buy a product whose internal structure is encrypted. Do you 
have the right to decrypt the underlying structure? If so, do you have the 
right to use that information in a commercial manner? What about a non- 
commercial manner? What if the encryption was done using a secret 
encryption system, and you discover the secret. Do you have the right to 
share that secret? 

8 . Some years ago the philosopher John Dewey (1859-1952) introduced the term 
"responsible technology." Give some examples of what you would consider to 
be "responsible technology." Based on your examples, formulate your own 
definition of "responsible technology." Has society practiced "responsible 
technology" over the last 100 years? Should actions be taken to ensure that it 
does? If so, what actions? If not, why? 


Additional Reading 539 


Additional Reading 

Garey, M. R. and D. S. Johnson. Computers and Intractability. New York: W. H. 
Freeman, 1979. 

Hamburger, H. and D. Richards. Logic and Language Models for Computer Science. 
Englewood Cliffs, NJ: Prentice-Hall, 2002. 

Hofstadter, D. R. Gddel, Escher, Bach: An Eternal Golden Braid. St. Paul, MN: Vintage, 
1980. 

Hopcroft, J. E., R. Motwani, and J. D. Ullman. Introduction to Automata Theory , 
Languages, and Computation, 2nd ed. Boston: Addison-Wesley, 2001. 

Lewis, H. R. and C. H. Papadimitriou. Elements of the Theory of Computation, 2nd ed. 
Englewood Cliffs, NJ: Prentice-Hall, 1998. 

Sipser, M. introduction to the Theory of Computation. Boston: PWS, 1996. 

Smith, C. and E. Kinber. Theory of Computing: A Gentle Introduction. Englewood 
Cliffs, NJ: Prentice-Hall, 2001. 

Sudkamp, T. A. Languages and Machines: An Introduction to the Theory of Computer 
Science, 3rd ed. Boston, MA: Addison-Wesley, 2006. 



Appendixes 


A ASCII 

B Circuits to Manipulate Two’s 
Complement Representations 

C A Simple Machine Language 

D High-Level Language Program 

Examples 

E The Equivalence of Iterative and 
Recursive Structures 

F Answers to Questions & Exercises 


# 

Jk 





ASCII 

The following is a partial listing of ASCII code, in which each bit pattern has been 
extended with a 0 on its left to produce the eight-bit pattern commonly used today. 


Symbol 

ASCII 

Symbol 

ASCII 

Symbol 

ASCII 

line feed 

00001010 

> 

00111110 

A 

01011110 

carriage return 

00001101 

? 

00111111 

_ 

01011111 

space 

00100000 

@ 

01000000 

3 

01 100001 

1 

00100001 

A 

01000001 

b 

01100010 

• 

00100010 

B 

01000010 

c 

0110001 1 

# 

0010001 1 

c 

01 00001 1 

d 

01100100 

S 

00100100 

D 

01000100 

e 

01100101 

% 

00100101 

E 

01000101 

f 

01100110 

& 

001001 10 

F 

01 0001 1 0 

g 

01 100111 

• 

001001 1 1 

G 

0100011 1 

h 

01 101000 

( 

00101000 

H 

01001000 

i 

01101001 

) 

00101001 

I 

01001001 

j 

01 101010 

* 

00101010 

J 

01001010 

k 

01 101011 


0010101 1 

K 

0100101 1 

1 

01101 100 


001011 00 

L 

010011 00 

m 

01 101101 

- 

00101 101 

M 

01001 101 

n 

01101110 


00101110 

N 

01001110 

0 

01101111 

/ 

00101 1 1 1 

0 

01001 1 1 1 

P 

01 1 1 0000 

0 

001 1 0000 

P 

01010000 

q 

01 110001 

1 

00110001 

Q 

01010001 

r 

01 110010 

2 

0011 0010 

R 

01010010 

s 

01 110011 

3 

0011 001 1 

s 

0101001 1 

t 

01 110100 

4 

00110100 

T 

01010100 

u 

01 110101 

5 

00110101 

u 

01010101 

V 

01110110 

6 

001101 1 0 

V 

0101011 0 

w 

01110111 

7 

001 10111 

w 

0101011 1 

X 

01 111000 

8 

001 11000 

X 

01011000 

v 

01111 001 

9 

001 11001 

Y 

0101 1001 

J 

z 

01111010 


001 11010 

z 

01011010 

{ 

} 

01111011 


0011 101 1 

( 

0101 101 1 

01111101 

< 

001111 00 

\ 

] 

010111 00 


= 

001 11101 

0101 1 101 
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Circuits to Manipulate Two's 
Complement Representations 

This appendix presents circuits for negating and adding values represented in two's 
complement notation. We begin with the circuit in Figure B.l that converts a four-bit 
two's complement representation to the representation for the negative of that value. 
For example, given the two's complement representation of 3, the circuit produces the 
representation for -3. It does this by following the same algorithm as presented in the 
text. That is, it copies the pattern from right to left until a 1 has been copied and then 
complements each remaining bit as it is moved from the input to the output. Because 
one input of the rightmost XOR gate is fixed at 0, this gate will merely pass its other 
input to the output. However, this output is also passed to the left as one of the inputs 
to the next XOR gate. If this output is 1, the next XOR gate will complement its input 
bit as it passes to the output. Moreover, this 1 will also be passed to the left through 
the OR gate to affect the next gate as well. In this manner, the first 1 that is copied to 
the output will also be passed to the left, where it will cause all the remaining bits to 
be complemented as they are moved to the: output. 

Next, let us consider the process of adding two values represented in two's com- 
plement notation. In particular, when solving the problem 

+ 0110 

± 10 11 

Figure B.l A circuit that negates a two's complement pattern 


Input 
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we proceed from right to left in a column-by-column manner, executing the same algo- 
rithm for each column. Thus once we obtain a circuit for adding one column of such 
a problem, we can construct a circuit for adding many columns merely by repeating 
the single-column circuit. 

The algorithm for adding a single column in a multiple-column addition prob- 
lem is to add the two values in the current column, add that sum to any carry from 
the previous column, write the least significant bit of this sum in the answer, and 
transfer any carry to the next column. The circuit in Figure B.2 follows this same 
algorithm. The upper XOR gate determines the sum of the two input bits. The lower 
XOR gate adds this sum to the value carried from the previous column. The two AND 
gates together with the OR gate pass any carry to the left. In particular, a carry of 1 
will be produced if the original two input bits in this column were 1 or if the sum of 
these bits and the carry were both 1. 

Figure B.3 shows how copies of this single-column circuit can be used to produce 
a circuit that computes the sum of two values represented in a four-bit two's com- 
plement system. Each rectangle represents a copy of the single-column addition cir- 
cuit. Note that the carry value given to the rightmost rectangle is always 0 because 
there is no carry from a previous column. In a similar manner, the carry produced 
from the leftmost rectangle is ignored. 


Figure B.2 A circuit to odd a single column in a multiple-column addition problem 


Upper bit 
from column 


Lower bit 
from column 


v 


V 




V 

Sum 
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The circuit in Figure B.3 is known as a rippk adder because the carry information 
must propagate, or ripple, from the rightmost to the leftmost column. Although sim- 
ple in composition, such circuits are slower to perform their functions than more 
clever versions, such as the lookahead carry adder, which minimize this column-to- 
column propagation. Thus the circuit in Figure B.3, although sufficient for our pur- 
poses, is not the circuit that is used in today's machines. 


Figure B.3 A circuit for adding two values in a two's complement notation 
using four copies of the circuit in Figure 8.2 


Upper input Lower input 



Sum 




A Simple Machine Language? 

In this appendix we present a simple but representative machine language. We begin 
by explaining the architecture of the machine itself. 


Machine Architecture 

The machine has 16 general-purpose registers numbered 0 through F (in hexadecimal). 

Each register is one byte (eight bits) long. For identifying registers within instruc- 
tions, each register is assigned the unique four-bit pattern that represents its register 
number. Thus register 0 is identified by 0000 (hexadecimal 0), and register 4 is iden- 
tified by 0100 (hexadecimal 4) . 

There are 256 cells in the machine's main memory. Each cell is assigned a unique 
address consisting of an integer in the range ofO to 255. An address can therefore be 
represented by a pattern of eight bits ranging from 00000000 to 11111111 (or a hexa- 
decimal value in the range of 00 to FF). 

Floating-point values are assumed to be stored in the eight-bit format discussed 
in Section 1.7 and summarized in Figure 1.26. 

Machine Language 

Each machine instruction is two bytes long. The first 4 bits provide the op-code; the last 
12 bits make up the operand field. The table that follows lists the instructions in hexa- 
decimal notation together with a short description of each. The letters R, S, and T are 
used in place of hexadecimal digits in those fields representing a register identifier that 
varies depending on the particular application of the instruction. The letters X and Y 
are used in lieu of hexadecimal digits in variable fields not representing a register. 

Op-code Operand Description 

1 RXY FOAD the register R with the bit pattern found in the memory cell whose 

address is XY. 

Example: 1 4A3 would cause the contents of the memory cell located at address 
A3 to be placed in register 4. 

2 RXY FOAD the register R with the bit pattern XY. 

Example: 20 A3 would cause the value A3 to be placed in register 0. 


3 


RXY 


STORE the bit pattern found in register R in the memory cell whose address 

is XY. 
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Op-code Operand Description 

Example: 35B] would cause the contents of register 5 to be placed in the memory cell 
whose address isBl. 


4 

5 


6 


7 


J5 


9 


A 


B 


C 


DBS MOVE the bit pattern found in register R to register S. 

Example: 40A4 would cause the contents of register A to be copied into register 4. 

RST ADD the bit patterns in registers S and T as though they were two's complement rep- 
resentations and leave the result in register R. 

Example: 5726 would cause the binary values in registers 2 and 6 to be added and the 
sum placed in register 7. 

RST ADD the bit patterns in registers S and T as though they represented values in floating- 
point notation and leave the floating-point result in register R. 

Example: 634 E would cause the values in registers 4 and E to be added as floating-point 
values and the result to be placed in register 3. 

RST OR the bit patterns in registers S and T and place the result in register R. 

Example: 7CB4 would cause the result of ORing the contents of registers B and 4 to be 
placed in register C. 

RST AND the bit patterns in registers S and T and place the result in register R. 

Example: 8045 would cause the result of ANDing the contents of registers 4 and 5 to be 
placed in register 0, 

RST EXCLUSIVE OR the bit patterns in registers S and T and place the result in register R. 

Example: 95F3 would cause the result of EXCLUSIVE ORing the contents of registers 
F and 3 to be placed in register 5. 

ROX ROTATE the bit pattern in register R one bit to the right X times. Each time place the 
bit that started at the low-order end at the high-order end. 

Example: A403 would cause the contents of register 4 to be rotated 3 bits to the right 
in a circular fashion. 

RXY JUMP to the instruction located in the memory cell at address XY if the bit pattern in 
register R is equal to the bit pattern in register number 0. Otherwise, continue with the 
normal sequence of execution. (The jump is implemented by copying XY into the pro- 
gram counter during the execute phase.) 

Example: B43C would first compare the contents of register 4 with the contents of reg- 
ister 0. If the two were equal, the pattern 3C would be placed in the program counter 
so that the next instruction executed would be the one located at that memory address. 
Otherwise, nothing would be done and program execution would continue in its nor- 
mal sequence. 

000 HALT execution. 

Example: C000 would cause program execution to stop. 


X 

■o 

c 

<1) 

a 

a 

o 



High-Level Language Program Examples 

This appendix presents sample programs in the languages Ada, C, C + + , C#, FOR- 
TRAN, and Java. Each program receives a list of names typed at the keyboard, sorts 
the list using the insertion sort algorithm, and prints the sorted list on the monitor 
screen. 

Ada 

The language Ada, named after Augusta Ada Byron (1815-1851), who was an advocate 
of Charles Babbage and the daughter of poet Lord Byron, was developed at the initia- 
tive of the U.S. Department of Defense in an attempt to obtain a single, general-purpose 
language for all its software development needs. A major emphasis during Ada's design 
was to incorporate features for programming real-time computer systems used as a part 
of larger machines such as missile guidance systems, environmental control systems 
within buildings, and control systems in automobiles and small home appliances. Ada 
thus contains features for expressing activities in parallel processing environments as 
well as convenient techniques for handling special cases (called exceptions) that might 
arise in the application environment. Ada is an imperative language with many object- 
oriented characteristics and therefore represents a step in the evolution from impera- 
tive programming to modern object-oriented languages. 

Figure D.l presents a sample Ada program. 


c 

The language C was developed by Dennis Ritchie at Bell Laboratories in the early 
1970s. Although originally designed as a language for developing system software, C 
has achieved popularity throughout the programming community and has been stan- 
dardized by the American National Standards Institute. 

C was originally envisioned as merely a step up from machine language. Conse- 
quently, its syntax is terse compared with other high-level languages that use complete 
English words to express some primitives that are represented by special symbols in 
C. This terseness allows for efficient representations of complex algorithms, which is 
a major reason for C's popularity. (Often a concise representation is more readable 
than a lengthy one.) 

Figure D.2 presents a sample program in C. 
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Figure D. 1 A sample Ado program 


— Program to manipulate a list 
with TEXTJO; 
use TEXTTO; 
procedure MAIN is 

subtype NAMEJTYPE is STRING ( 1 . . 8 ) ; 
LIST_LENGTH: constant := 10; 

NAMES: array (l..LIST_LENGTH) of NAMEJTYPE; 
PIVOT: NAMEJTYPE; 

HOLE: INTEGER; 
begin 

--First, get the names from the terminal, 
for K in l..LIST_LENGTH loop 
GET(NAMES(K)); 
end loop; 

--Sort the list (HOLE contains the location of the 
hole in the list from the time the 
pivot is removed until it is 
reinserted.) 

for N in 2..LIST_LENGTH loop 
PIVOT := NAMES(N); 

HOLE := N; 

for M in reverse 1 . . N - 1 loop 
if NAMES(M) > PIVOT 

then NAMES(M +1) := NAMES(M); 

else exit; 
end if ; 

HOLE := M; 
end loop ; 

NAMES(HOLE) := PIVOT; 
end loop; 

--Now, print the sorted list, 
for K ill 1 .. LI STRENGTH loop 
NEWJJNE; 

PUT(NAMES(K)); 
end loop ; 
end MAIN; 


C++ 

The language C + + was developed by Bjame Stroustrup at Bell Laboratories as an 
enhanced version of the language C. The goal was to produce a language compatible 
with the object-oriented paradigm. 

Figure D.3 presents an implementation of the insertion sort algorithm in C + +. The 
last four statements in this program request that an object named namelist be estab- 
lished having "type" list and that this new object perform the operations getnames, 
sort names, and printnameson itself. The preceding portion of the program defines 


Figure D.2 A sample C program 


/* Program to manipulate a list */ 

#include <stdio.h> 
iinclude <string.h> 

int main () 

{ 

char names [10] [ 9 ] . pivot [ 9 ] ; 
int i, j ; 

/* get the names */ 

for (i = 0; i < 10,- + + i) 
scant("%8s M . names [ i ] ) ; 

/*sort the list */ 

for (i = 1; i < 10; ++i) 

{ 

strcpy (pivot , names [ i ] ) ; 
j = i - 1; 

while ( ( j >= 0 ) && ( strcmp (pivot , names [ j ] ) < 0)) 

{ strcpy (names [ j +1 ] , names [ j ] ) ; - - j ; } ; 

strcpy (names [ j+1 ] , pivot); 

} 

/ -print the sorted list */ 
for (i = 0; i < 10; + + i) 

print f ("%s\n",names [i] ) ; 


the properties that any object of "type" list is to possess. In particular, any such object 
is to contain an internal array of characters called names and three operations called 
getnames, sortlist, and printnames. Note that the definitions of these operations 
are the same as portions of the C language program in figure D.2 . The difference is that 
in the C + + program these operations are considered to be a part of an object's proper- 
ties, whereas in the C program they are considered as units within the procedural part 
of the program. 


c# 

The language C# was developed by Microsoft to be a tool in the .NET Framework, 
which is a comprehensive system tor developing application software for machines 
running Microsoft system software. As the example in Figure D.4 shows, a C# program 
looks much like a program in C + + or Java. Indeed, the reason Microsoft introduced 
C# as a different language was not that it is truly new in the language sense, but that, 
as a different language, Microsoft could customize specific features of the language 
without concern for standards that were already associated with other languages or 


Figure D.3 A sample C++ program 


// Program to manipulate a list 

#include <iostream.h> 

#include <string.h> 

#include <iomanip> 

const int ListLength = 10; 

// All list objects contain a list of names and three public 
// methods called getnames, sortlist, and printnames . 

class list 
{private : 

char names [ Li st Length ] [9] , - 
public : 

void getnames () 

{int i; 

for (i = 0; i < ListLength; ++i) 

cin » std::setw(9) » names [i] ; 

J 

void sortlist () 

{int i , j ; 
char pivot [ 9 ] ; 

for (i = 1; i < ListLength; + + i) 

{strcpy (pivot, names [i] ) ; 

J = i - 1 ; 

while ((j >= 0) (strcmp (pivot, names [j]) < 0)) 

( s crcpy ( names [ j + 1 ] , names [j] ) ; 

— j ; 

} 

strcpy (names [ j + 1 ] , pivot); 

} 

} 

void printnamesO 
{int i; 

cout << endl; 

for (i = 0; i < ListLength; ++i) 

, cout « names [i] « endl; 

}; 

// Establish an object called namelist and ask it to 
// collect some names, sort them, and print the list. 

int main ! ) 

{list namelist; 
namelist . getnames ( ) ; 
namelist . sort list ( ) ; 

namelist . printnames ( ) ; 
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Figure D.4 A sample program in C# 


// Program to manipulate a list 

// All list objects contain a list of names and three public 
// methods called GetNames, SortNames, and PrintNames . 

class List { 

const int ListLength = 10; 

private String!] Names; 

ListU { 

Names = new St ring [ Li st Length ] ; 

} 

public void GetNamesO { 

for (int i = 0 ; i < ListLength; i + +) 

Namesti] = System . Console . ReadLine () ; 

} 


public void SortNames () { 

int j ; 

String Pivot; 

fordnt i = 1; i < ListLength; i + +) { 

Pivot = Names [i] ; 

j = i - l; 

while (<j>= 0) && String . Compare (Pivot , Names [j], true) 

Names] j + 1] = Names [j]; 

j - ; 

} 

} 

Names [j+1] = Pivot; 


public void PrintNames () { 

fordnt i = 0 ; i < ListLength; i++) 

System. Console . WriteLine (Names [ i 1 ) ; 

} 

} 

// Establish an object called NameList and ask it to 
// collect some names, sort them, and print the results. 

class Sort { 

public static void main() { 

List NameList = new List () ; 

NameList . GetNames< ) ,- 
Namelist . SortNames () ,- 
Namelist . PrintNames ( ) ; 

Return 0 ; 


< 0 )) { 


} 
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for proprietary rights of other corporations. Thus the novelty of C# is in its role as a 
prominent language for developing software utilizing the .NET Framework. With 
Microsoft's backing, C# and the .NET Framework promise to be prominent players in 
the world of software development for years to come. 


FORTRAN 

FORTRAN is an acronym for FORmula TRANslator. This language was one of the first 
high-level languages developed (it was announced in 1957) and one of the first to gain 
wide acceptance within the computing community. Over the years its official descrip- 
tion has undergone numerous extensions, meaning that today's FORTRAN language 
is much different from the original. Indeed, by studying the evolution of FORTRAN, 
one would witness the effects of research in programming language design. Although 
originally designed as an imperative language, newer versions of FORTRAN now 
encompass many object-oriented features. FORTRAN continues to be a popular lan- 
guage within the scientific community. In particular, many numerical analysis and 
statistical packages are, and will probably continue to be, written in FORTRAN. Figure 
D.5 presents a sample program written in one of the earlier versions of FORTRAN. 


Figure D.5 A sample FORTRAN program 


! Program to manipulate a list 

INTEGER J,K 

CHARACTER (LEN=8) Pivot 

CHARACTER (LEN=8) D IMENS ION ( 1 0 ) Names 
! First, get the names. 

READ (UNIT=5, FMT=100) (Names (K) , K=l,10) 

100 FORMAT (A8) 

! Now, sort the list . 

OuterLoop: DO J=2, 10 

Pivot = Names (J) 

InnerLoop: DO K=J-1, 1,-1 

IF (Names (K) . GT . Pivot) THEN 

Names (K+l) = Names (K) 

ELSE 

EXIT InnerLoop 

END IF 

END DO InnerLoop 
Names (K+l) = Pivot 

END DO OuterLoop 
I Now, print the sorted list. 

WRITE (UNIT = 6 , FMT=4 0 0 ) (Names (K) , K=l, 10) 

4 00 FORMAT ('',A8) 

END 
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Figure D.6 A sample Java program 


// Program to manipulate a list 
import java . io . 

// All list objects contain a list oE names and three public 
// methods called getnames, sortnames, and printnames . 

class list { 

final int ListLength = 10; 

private String! 1 names; 
public list ! ) { 

names = new St ring [ Li st Length ] ; 

} 

public void getnames () { 

Datalnput data = new DatalnputSt ream (System, in) 
for (i = 0; i < ListLength; i + +) 

try (names [i] = dat a . readLine ( ) ; } 

} 

catch ( IOExcept ion e) () ; 

} 

public void sortnames () { 

int i , j ; 

String pivot; 

for (i = l; i < ListLength; i + + ) { 

pivot = names [i] ; 
j = i - 1; 

while [(j >= 0) && (pivot . compareTolnames ] j ] ) < 0)) { 

names [j + 1 ] = names [j] ; 

j i 

) 

names [j+1] = pivot; 


) 

public void printnames () { 

int i ; 

for (i = 0; i < ListLength; i + +) 

System .out. print In (names [ i ] ) ; 

} 

} 

// Establish an object called namelist and ask it to 
// collect some names, sort them, and print the results, 
class sort { 

public static void main (String args [ ] ) { 
list namelist = new list O; 
namelist .getnames () ,- 
namelist . sortnames ( ) ; 
namelist . printnamesl ) ,- 


} 
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Java 

Java is an object-oriented language developed by Sun Microsystems in the early 1990s. 
Its designers borrowed heavily from C and C + + . The excitement over Java is due, not 
to the language itself, but to "the language's universal implementation and the vast 
number of predesigned templates that are available in the Java programming envi- 
ronment. The universal implementation means that a program written in Java can be 
executed efficiently over a wide range of machines; and the availability of templates 
means that complex software can be developed with relative ease. For example, tem- 
plates such as applet and servlet streamline the development of software for the World 
Wide Web. 

Figure D.6 presents a sample program in Java. Note the resemblance between 
Java and C + +. 



The Equivalence of Iterative and Recursive Structures 

In this appendix, we use our Bare Bones language of Chapter 11 as a tool to answer 
the question posed in Chapter 4 regarding the relative power of iterative and recur- 
sive structures. Recall that Bare Bones contains only three assignment statements 
(clear, incr, and deer) and one control structure (constructed from a while-end state- 
ment pair). This simple language has the same computing power as a Turing machine; 
thus, if we accept the Church-Turing thesis, we might conclude that any problem with 
an algorithmic solution has a solution expressible in Bare Bones. 

The first step in the comparison of iterative and recursive structures is to replace 
the iterative structure of Bare Bones with a recursive structure. We do this by removing 
the while and end statements from the language and in their place providing the abil- 
ity to divide a Bare Bones program into units along with the ability to call one of these 
units from another location in the program. More precisely, we propose that each 
program in the modified language consist of a number of syntactically disjoint program 
units. We suppose that each program must contain exactly one unit called MAIN hav- 
ing the syntactic structure of 

MAIN: begin; 


end; 

(where the dots represent other Bare Bones statements) and perhaps other units 
(semantically subordinate to MAIN) that have the structure 

unit: begin; 


return; 

(where unit represents the unit's name that has the same syntax as variable names). 
The semantics of this partitioned structure is that the program always begins execu- 
tion at the beginning of the unit MAIN and halts when that unit's end statement is 
reached. Program units other than MAIN can be called as procedures by means of the 
conditional statement 

if name not 0 perform unit; 
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(where name represents any variable name and unit represents any of the program 
unit names other than MAIN). Moreover, we allow the units other than MAIN to call 
themselves recursively. 

With these added features, we can simulate the while-end structure found in the 
original Bare Bones. For example, a Bare Bones program of the form 

while X not 0 do; 

5; 

end; 

(where 5 represents any sequence of Bare Bones statements) can be replaced by the 
unit structure 

MAIN: begin; 

ifx not 0 perform unitA; 
end; 

unitA: begin; 

S; 

if X not 0 perform unitA; 
return; 

Consequently, we conclude that the modified language has all the capabilities of 
the original Bare Bones. 

It can also be shown that any problem that can be solved using the modified lan- 
guage can be solved using Bare Bones. One method of doing this is to show how any 
algorithm expressed in the modified language could be written in the original Bare 
Bones. However, this involves an explicit description ofhow recursive structures can 
be simulated with the while-end structure of Bare Bones. 

For our purpose, it is simpler to rely on the Church-Turing thesis as presented in 
Chapter 1 1 . In particular, the Church-Turing thesis, combined with the fact that Bare 
Bones has the same power as Turing machines, dictates that no language can be more 
powerful than our original Bare Bones. Therefore, any problem solvable in our mod- 
ified language can also be solved using Bare Bones. 

We conclude that the power of the modified language is the same as that of the 
original Bare Bones. The only distinction between the two languages is that one pro- 
vides an iterative control structure and the other provides recursion. Thus the two con- 
trol structures are in fact equivalent in terms of computing power. 


X 


•a 

c 

a 
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Answers to Questions & Exercises 

Chapter 1 

Section 1.1 

1. One and only one of the upper two inputs must be 1, and the lowest input 
must be 1. 

2. The 1 on the lower input is negated to 0 by the NOT gate, causing the output 
of the AND gate to become 0. Thus both inputs to the OR gate are 0 (remem- 
ber that the upper input to the flip-flop is held at 0) so the output of the OR 
gate becomes 0. This means that the output of the AND gate will remain 0 
after the lower input to the flip-flop returns to 0. 

3. The output of the upper OR gate will become 1, causing the upper NOT gate 
to produce an output of 0. This will cause the lower OR gate to produce a 0, 
causing the lower NOT gate to produce a 1. This 1 is seen as the output of the 
flip-flop as well as being fed back to the upper OR gate, where it holds the out- 
put of that gate at 1, even after the flip-flop's input has returned to 0. 

4 . The flip-flop will be shielded from the circuit's input values when the clock is 

0. The flip-flop will respond to the circuit's input values when the clock is 1. 

5. a. The entire circuit is equivalent to a single XOR gate. 

b. This entire circuit is also equivalent to a single XOR gate. 

6. a. 6AF2 b. E85517 c. 48 

7. a. 01011111110110010111 

b. 0110000100001010 

c. 1010101111001101 

d. 0000000100000000 

Section 1.2 

1. In the first case, memory cell number 6 ends up containing the value 5. In 
the second case, it ends up with the value 8. 

2. Step 1 erases the original value in cell number 3 when the new value is writ- 
ten there. Consequently, Step 2 does not place the original value from cell 
number 3 in cell number 2. The result is that both cells end up with the value 
that was originally in cell number 2. A correct procedure is the following: 
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Step 1. Move the contents of cell number 2 to cell number 1. 

Step 2. Move the contents of cell number 3 to cell number 2. 

Step 3. Move the contents of cell number 1 to cell number 3. 

3. 32768 bits. 

Section 1.3 

1. Faster retrieval of data and higher transfer rates. 

2. The point to remember here is that the slowness of mechanical motion compared 
with the speed of the internal functioning of the computer dictates that we mini- 
mize the number of times we must move the read/write heads. If we fill a com- 
plete surface before starting the next, we must move the re ad/ write head each 
time we finish with a track. The number of moves therefore is approximately the 
same as the total number of tracks on the two surfaces. If, however, we alternate 
between surfaces by electronically switching between the read/write heads, we 
must move the read/write heads only after each cylinder has been filled. 

3. In this application, information must be retrieved from mass storage in a ran- 
dom manner, which would be time consuming in the context of the spiral sys- 
tem used on CDs and DVDs. (Moreover, current technology does not allow 
individual portions of data to be updated on a CD or DVD.) 

4. Storage space is allocated in units of physical sectors (actually in units of 
groups of sectors in most cases). If the last physical sector is not full, addi- 
tional text can be added without increasing the storage space allocated to the 
file. If the last physical sector is full, any addition to the document will 
require additional physical sectors to be allocated. 

5. Flash drives do not require physical motion so they have shorter response 
times and do not suffer from physical wear. 

6 . A buffer is a data storage area used to hold data on a temporary basis, usually 
as a means of absorbing inconsistencies between the data's source and ulti- 
mate destination. 

Section 1.4 

1. Computer science. 

2. The two patterns are the same, except that the sixth bit from the low-order 
end is always 0 for uppercase and 1 for lowercase. 


3. a. 01010111 

01101000 

01100101 

01110010 

01100101 

00100000 

01100001 

01110010 

01100101 

00100000 

01111001 

01101111 

01110101 

00111111 



b. 00100010 

01001000 

01101111 

01110111 

00111111 

00100010 

00100000 

01000011 

01101000 

01100101 

01110010 

01111001 

01101100 

00100000 

01100001 

01110011 

01101011 

01100101 

01100100 

00101110 
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c. 00110010 
00110101 


00101011 00110011 
00101110 


00111101 


4. 



5. a. 5 b. 9 c. 11 d. 6 e. 16 f. 18 

6. a. 110 b. 1101 c. 1011 d. 10010 e. 11011 f. 100 

7. In 24 bits, we can store three symbols using ASCII. Thus we can store values 
as large as 999. However, if we use the bits as binary digits, we can store val- 
ues up to 16,777,215. 

S. a. 15.15 b. 51.0.128 c. 10.160 

9. As emphasized in the text, vector techniques are more conducive to changes 
in scale than images encoded as bit maps. For simple line drawings, they can 
also be more compact. On the other hand, vector techniques do not provide 
the same photographic quality that bit maps produce. 

10. With a sample rate of 44,100 samples per second, one hour of stereo music 
would require 635,040,000 bytes of storage. Thus, it would just about fill a CD 
whose capacity is slightly more than 600MB. 


Section 1.5 


1. a. 42 

b. 

33 

2. a. 100000 

b. 

1000000 


3. a. 3V, 

4. a. 100.1 

5. a. 100111 


b. 57a 

b. 10.11 

b. 1011.110 


c. 23 

c. 1100000 
c. 2'h 

c. 1.001 
c. 100000 


d. 6 

d. 1111 

d. 67„ 
d. 0.0101 
d. 1000.00 


e. 31 

e. 11011 
e. *A 

e. 101.101 


Section 1.6 


1. a. 3 b. 15 


-4 d. -6 e. 0 f. -16 


2. a. 00000110 b. linioio 

d. 00001101 c. 11111111 


c. 11101111 
f. 00000000 


3. a. 11111111 
d. 00000010 


b. 10101011 c 00000100 

e. 00000000 f. 10000001 


4. a. With 4 bits the largest value is 7 and the smallest is - 8. 

b. With 6 bits the largest value is 31 and the smallest is -32. 

c. With 8 bits the largest value is 127 and the smallest is -128. 

5, a. 0111 (5 + 2 = 7) b. 0100 (3+1=4) c. 1111 (5 + (-6) = -1) 

d. 0001 (-2 + 3 = 1) e. 1000 (-6 + (-2) = -8) 
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6. a. 0111 b. 1011 (overflow) 

d. 0001 e. 1000 (overflow) 


c. 0100 (overflow) 


7. a. 0110 
+ 0001 

0111 


b. 0011 
+ 1110 


0001 


c. 0100 
+ 1010 


1110 


d. 0010 
+ 0100 


01J 0 


e. 0001 
+ 1011 


1100 


6. No. Overflow occurs when an attempt is made to store a number that is too 
large for the system being used. When adding a positive value to a negative 
value, the result must be between the values being added. Thus, if the origi- 
nal values are small enough to be stored, the result is also. 

9. a. 6 because 1110 -» 14 •- 8 

b. -1 because 0111 -» 7 — 8 

c. 0 because 1000 -> 8 - 8 

d. -6 because 0010 -» 2 - 8 

e. -8 because 0000 -> 0 - 8 

f. 1 because 1001 -» 9 - 8 

10. a. 1101 because 5 + 8 = 13 -» 1101 

b. 0011 because -5 + 8 = 3 — » 0011 

c. 1011 because 3 + 8 = 11 -> 1011 

d. 1000 because 0 + 8 = 8 - > 1000 

e. 1111 because 7 + 8 = 15 - A llll 

f. 0000 because -8 +8=0 ->0000 

11. No. The largest value that can be stored in excess eight notation is 7, represented 
by 1111. To represent a larger value, at least excess 16 (which uses patterns of 5 
bits) must be used. Similarly, 6 cannot he represented in excess four notation. 
(The largest value that can be represented in excess four notation is 3.) 

Section 1.7 

1. a. 7s b. 3% c. 7« d. -1V4 e. -("/<*) 

2. a. 01101011 b. 01111010 (truncation error) 

c. 01001100 d. 11101110 e. 11111000 (truncation error) 

3 . 01001001 O) is larger than 00111101 ( % , ) . The following is a simple way of 
determining which of two patterns represents the larger value: 

Case 1. If the sign bits are different, the larger is the one with 0 sign bit. 

Case 2. If the sign bits are both 0, scan the remaining portions of the patterns 
from left to right until a bit position is found where the two patterns 
differ. The pattern containing the 1 in this position represents the 
larger value. 

Case 3. If the sign bits are both 1, scan the remaining portions of the patterns 

from left to right until a bit position is found where the two patterns differ. 
The pattern containing the 0 in this position represents the larger value. 

The simplicity of this comparison process is one of the reasons for represent- 
ing the exponent in floating-point systems with an excess notation rather than 
with two's complement. 


4. The largest value would be 77., which is represented by the pattern 01111111. 
As for the smallest positive value, you could argue that there are two "cor- 
rect" answers. First, if you stick to the coding process described in the text, 
which requires the most significant bit of the mantissa to be 1 (called 
normalized form), the answer is ' / « , which is represented by the pattern 
00001000. However, most machines do not impose this restriction for values 
close to 0. For such a machine, the correct answer is 1 / » represented by 


00000001. 


Section 1.8 

1 . Run-length encoding, frequency-dependent encoding, relative encoding, and 
dictionary encoding. 

2. 121321112343535 

3. Color cartoons consist of blocks of solid color with sharp edges. Moreover, the 
number of colors involved is limited. 

4. No. Both GIF and JPEG are lossy compression systems, meaning that details 
in the image will be lost. 

5. JPEG's baseline standard takes advantage of the fact that the human eye is 
not as sensitive to changes in color as it is to changes in brightness. Thus it 
reduces the number ofbits used to represent color information without 
noticeable loss in image quality. 

6 . Temporal masking and frequency masking. 

7. When encoding information, approximations are made. In the case of 
numeric data, these approximations are compounded when computations 
are performed, which can lead to erroneous results. Approximations are 
not as critical in the cases of images and sound because the encoded 
data are normally only stored, transferred, and reproduced. If, however, 
images or sound were repeatedly reproduced, rerecorded, and then reen- 
coded, these approximations could compound and ultimately lead to 
worthless data. 

Section 1.9 

1- b, c, and e. 

2. Yes. If an even number of errors occurs in one byte, the parity technique does 
not detect them. 

3. In this case, errors occur in bytes a and d of Question I. The answer to 
Question 2 remains the same. 


4. a. 001010111 001101000 

101110010 101100101 

001100001 101110010 

000100000 001111001 

001110101 100111111 


101100101 

000100000 

101100101 

101101111 
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b. 100100010 


101001000 

100111111 

001000011 

101110010 

000100000 

001101011 

100101110 

100101011 

100110101 


101101111 

100100010 

001101000 

001111001 

001100001 

101100101 


101110111 

000100000 

101100101 

101101100 

001110011 

001100100 


c. 000110010 
000111101 


100110011 

100101110 


5. a. BED 


b. CAB 


c. HEAD 


6. One solution is the following: 

A 00000 
B 11100 
C 0 I 1 1 1 
D 10 0 11 

Chapter 2 

Section 2.1 

1 . On some machines this is a two-step process consisting of first reading the 
contents from the first cell into a register and then writing it from the register 
into the destination cell. On most machines, this is accomplished as one activ- 
ity without using an intermediate register. 

2. The value to be written, the address of the cell in which to write, and the 
command to write. 

3. General-purpose registers are used to hold the data immediately applicable to 
the operation at hand; main memory is used to hold data that will be needed 
in the near future; and mass storage is used to hold data that will likely not be 
needed in the near future. 

Section 2.2 

1. The term move often carries the connotation of removing from one location 
and placing in another, thus leaving a hole behind. In most cases within a 
machine, this removal does not take place. Rather, the object being moved is 
most often copied (or cloned) into the new location. 

2. A common technique, called relative addressing, is to state how far rather 
than where to jump. For example, an instruction might be to jump forward 
three instructions or jump backward two instructions. You should note, how- 
ever, that such statements must be altered if additional instructions are later 
inserted between the origin and the destination of the jump. 

3. This could be argued either way. The instruction is stated in the form of a 
conditionaljump. However, because the condition that 0 be equal to 0 is 
always satisfied, the jump will always be made as if there were no condition 


stated at all. You will often find machines with such instructions in their 
repertoires because they provide an efficient design. For example, if a 
machine is designed to execute an instruction with a structure such as 
"If... jump to..." this instruction form can be used to express both conditional 
and unconditional j ump s . 

4. 156C = 0001010101101100 
166D = 0001011001101101 
5056 = 0101000001010110 
306E = 0011000001101110 
GOOO = 1100000000000000 

5. a. STORE the contents of register 6 in memory cell number 8 A. 

b. JUMP to location DE if the contents of register A equals that of register 0. 

c. AND the contents of registers 3 and C, leaving the result in register 0. 

d. MOVE the contents of register F to register 4. 

6 . The instruction 15AB requires that the CPU query the memory circuitry for 
the contents of the memory cell at address AB. This value, when obtained 
from memory, is then placed in register 5. The instruction 25 AB does not 
require such a request of memory. Rather, the value AB is placed in register 5. 

7. a. 2356 b. A503 c. 80A5 

Section 2.3 

1. Hexadecimal 34 

2. a. OF b. C3 

3. a. 00 b. 01 c. four times 

4. It halts. This is an example of what is often called self-modifying code. That 
is, the program modifies itself. Note that the first two instructions place hexa- 
decimal CO at memory location F8, and the next two instructions place 00 at 
location F9. Thus, by the time the machine reaches the instruction at F8, the 
halt instruction (COOO) has been placed there. 

Section 2.4 


a. 

00001011 

b. 10000000 

c. 

00101101 

d. 

11101011 

e. 11101111 

f. 

11111111 

g- 

11100000 

h. 01101111 

1 . 

11010010 


2 00111100 with the AND operation 

3 00111100 with the XOR operation 

4. a. The final result is 0 if the string contained an even number of Is. 

Otherwise it is 1. 

b. The result is the value of the parity bit for even parity. 

5 The logical XOR operation mirrors addition except for the case where both 
operands are 1, in which case the XOR produces a 0, whereas the sum is 10. 

(Thus the XOR operation can be considered an addition operation with no carry.} 


6 . Use AND with the mask 11011111 to change lowercase to uppercase. Use OR 
with 00100000 to change uppercase to lowercase. 

7. a. 01001101 b. 11100001 c. 11101111 

8. a. 57 b. B8 c. 6F d. 6A 

9. 5 

10. 00110110 in two's complement; 01011110 in floating-point. The point here is 
that the procedure used to add the values is different depending on the inter- 
pretation given the bit patterns. 

11 . One solution is as follows: 

12A7 (LOAD register 2 with the contents of memory cell A7 .) 

2380 (LOAD register 3 with the value 80.) 

7023 (OR registers 2 and 3 leaving the result in register 0.) 

30A7 (STORE contents of register 0 in memory cell A7 . ) 

C000 (HALT) 

12 . One solution is as follows: 

15E0 (LOAD register 5 with the contents of memory cell EO.) 

A502 (ROTATE 2 bits to the right the contents of register 5.) 

260F (LOAD register 6 with the value OF.) 

8056 (AND registers 5 and 6, leaving the result in register 0.) 

30E1 (STORE the contents of register 0 in memory cell El. ) 

C000 (HALT.) 


ection 2.5 

1. a. 37B5 

b. One million times 

c. No. A typical page of text contains less than 4000 characters. Thus the abil- 
ity to print five pages in a minute indicates a printing rate of no more than 
20,000 characters per minute, which is much less than one million charac- 
ters per second. (The point is that a computer can send characters to a 
printer much faster than the printer can print them; thus the printer needs 
a way of telling the computer to wait.) 

2. The disk will make 50 revolutions in one second, meaning that 800 sectors 
will pass under the read/write head in a second. Because each sector contains 
1024 bytes, bits will pass under the read/write head at approximately 6.5 
Mbps. Thus communication between the controller and the disk drive will 
have to be at least this fast if the controller is going to keep up with the data 
being read from the disk. 

3. A 300-page novel represented in ASCII consists of about 1MB or 8,000,000 
bits. Thus approximately 139 seconds (or 2'A minutes) would be required to 
transfer the entire novel at 57,600 bps. 
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Section 2.6 

1. The pipe would contain the instructions BIBO (being executed), 5002, and 
perhaps even BOAA. If the value in register 1 is equal to the value in regis- 
ter 0, the jump to location BO is executed, and the effort already expended 
on the instructions in the pipe is wasted. On the other hand, no time is 
wasted because the effort expended on these instructions did not require 
extra time. 

2 . If no precautions are taken, the information at memory locations F8 and F9 is 
fetched as an instruction before the previous part of the program has had a 
chance to modify these cells. 

3. a. The CPU that is trying to add 1 to the cell can first read the value in the 

cell. Following this the other CPU reads the cell's value. (Note that at this 
point both CPUs have retrieved the same value.) If the first CPU now finishes 
its addition and writes its result back in the cell before the second finishes 
its subtraction and writes its result, the final value in the cell reflects only 
the activity of the second CPU. 

b. The CPUs might read the data from the cell as before, but this time the sec- 
ond CPU might write its result before the first. Thus only the activity of the 
first CPU is reflected in the cell's final value. 


Chapter 3 

Section 3.1 

1 . A traditional example is the line of people waiting to buy tickets to an event. 
In this case there might be someone who tries to "break in line," which would 
violate the FIFO structure. 

2 . Options (b) and (c) . 

3. Real-time processing refers to coordinating the execution of a program with 
activities in the machine's environment. Interactive processing refers to a 
person's interaction with a program as it executes. Good real-time characteris- 
tics are needed for successful interactive processing. 

4. Time-sharing is the technique by which multitasking is accomplished on a 
single-processor machine. 

Section 3.2 

1 . Shell Communicates with the machine's environment. 

File manager: Coordinates the use of the machine's mass storage. 

Device drivers: Handle communication with the machine's peripheral devices. 
Memory manager. Coordinates the use of the machine's main memory. 
Scheduler: Coordinates the processes in the system. 

Dispatcher: Controls the assignment of processes to CPU time. 
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2. The line is vague, and the distinction is often in the eye of the beholder. 
Roughly speaking, utility software performs basic, universal tasks, whereas 
application software performs tasks unique to the machine's application. 

3. Virtual memory is the imaginary memory space whose apparent presence is 
created by the process of swapping data and programs back and forth between 
main memory and mass storage. 

4. when the machine is turned on, the CPU begins executing the bootstrap, 
which resides in ROM. This bootstrap directs the CPU through the process of 
transferring the operating system from mass storage into the volatile area of 
main memory. When this transfer is complete, the bootstrap directs the CPU 
to jump to the operating system. 

Section 3.3 

1 . A program is a set of directions. A process is the action of following those 
directions. 

2. The CPU completes its current machine cycle, saves the state of the current 
process, and sets its program counter to a predetermined value (which is the 
location of the interrupt handler). Thus the next instruction executed will be 
the first instruction within the interrupt handler. 

3. They could be given higher priorities so that they would be given preference 
by the dispatcher. Another option would be to give the higher-priority 
processes longer time slices. 

4. If each process consumed its entire time slice, the machine could provide a 
complete slice to almost 2 0 processes in one second. If processes did not con- 
sume their entire time slices, this value could be much higher, but then the 
time required to perform a context switch might become more significant (see 
Problem 5 ) . 

5. A total of™/™ ofthe machine's time would be spent actually performing 
processes. However, when a process requests an I/O activity, its time slice is 
terminated while the controller performs the request. Thus if each process 
made such a request after only one microsecond of its time slice, the effi- 
ciency ofthe machine would drop to '/>. That is, the machine would spend as 
much time performing context switches as it would executing processes. 

Section 3.4 

1. This system guarantees that the resource is not used by more than one 
process at a time; however, it dictates that the resource be allocated in a 
strictly alternating fashion. Once a process has used and relinquished the 
resource, it must wait for the other process to use the resource before the 
original process can access it again. This is true even if the first process 
needs the resource right away and the other process will not need it for 
some time. 
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2. If two cars enter opposite ends of the tunnel at the same time, they will not be 
aware of the other's presence. The process of entering and turning on the lights 
is another example of a critical region, or in this case we might call it a critical 
process. In this terminology, we could summarize the flaw by saying that cars at 
opposite ends of the tunnel could execute the critical process at the same time. 

3. a. This guarantees that the nonshareable resource is not required and allocated 

on a partial basis; that is, a car is given the whole bridge or nothing at all. 

b. This means that the nonshareable resource can be forcibly retrieved. 

c. This makes the nonshareable resource shareable, which removes the 
competition. 

4. A sequence of arrows that forms a closed loop in the directed graph. It is on 
this observation that techniques have been developed that allow some operat- 
ing systems to recognize the existence of deadlock and consequently to take 
appropriate corrective action. 

Section 3.5 

1. Names and dates are considered poor candidates because they are common 
choices and therefore represent easy targets for password guessers. The use of 
complete words is also considered poor because password guessers can easily 
write a program to try the words found in a dictionary. Moreover, passwords 
containing only characters are discouraged because they are formed from a 
limited character set. 

2. Four is the number of different bit patterns that can be formed using two bits. 
If more privilege levels were required, the designers would need at least three 
bits to represent the different levels and would therefore probably choose to 
use a total of eight levels. In the same manner, the natural choice for fewer 
than four privilege levels would be two, which is the number of patterns that 
can be represented with one bit. 

3. The process could alter the operating system program so that the dispatcher 
gave every time slice to that process. 

Chapter 4 

Section 4.1 

1 . An open network is one whose specifications and protocols are public, allow- 
ing different vendors to produce compatible products. 

2. Both connect two buses to form a larger bus network. However, a repeater for- 
wards all messages whereas a bridge forwards only those messages destined 
for the other side of the bridge. 

3. A router is a machine connecting two networks to form an internet. The term 
gateway is often used to refer to a router that connects a domain to the rest of 
an internet. 
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4 . How about a mail order business and its clients, a bank teller and the bank's 
customers, or a pharmacist and his or her customers? 

5. There are numerous protocols involved in traffic flow, verbal telephone com- 
munication, and etiquette. 

Section 4.2 

1. A network identifier identifies a domain. A host address identifies a machine 
within a domain. The two combined make up an IP address. 

2. The complete Internet address of a host consists of the network identifier and 
the host address. 

3. 3.4.5 represents the three-byte pattern 000000110000010000000101. The bit 
pattern 0001001100010000 would be represented as 19.16 in dotted decimal 
notation. 

4. There could be several answers to this. One is that they both progress from 
the specific to the general. Internet addresses in mnemonic form begin with 
the name of a particular machine and progress to the name of the TLD. Postal 
addresses begin with the name of an individual and progress to increasingly 
larger regions such as city, state, and country. This order is reversed in IP 
addresses, which start with the bit pattern identifying the domain. 

5. Name servers help translate mnemonic addresses into IP addresses. Mail 
servers send, receive, and store email messages. FTP servers provide file 
transfer service. 

6. SSH provides encryption and authentication. 

Section 4.3 

1 - A URL is essentially the address of a document in the World Wide Web. A 
browser is a program that assists a user in accessing hypertext. 

2. A markup language is a system for inserting explanatory information in a 
document. 

3. HTML is a particular markup language. XML is a standard for producing 
markup languages. 

4. a. <html> marks the beginning of an HTML document. 

b. < head > marks the beginning of a document's head. 

c. < /body> marks the end of a document's body. 

d. </a> marks the end ofan item that is linked to another document. 

5. Client side and server side are terms used to identify whether an activity is 
performed at the client's computer or the server's computer. 

Section 4.4 

I. The link layer receives the message and hands it to the network layer. The 
network layer notes that the message is for another host, attaches another 


intermediate destination address to the message, and gives the message back 
to the link layer. 

2. Unlike TCP, UDP is a connectionless protocol that does not confirm that the 
message was received at the destination. 

3. Each message is assigned a hop count that determines the maximum number 
of times the message will be relayed. 

4. Nothing really. A programmer at any host could modify the software at 
that host to keep such records. This is why sensitive data should be 
encrypted. 

Section 4.5 

1. Probably the most common way for malware to enter a computer system is 
via attachments to email messages or being hidden in software that is down- 
loaded by the victim. However, spyware is often placed on unsuspecting com- 
puters by Web servers that are merely visited by the victim. 

2. A domain's gateway is a router that merely forwards packets (parts of mes- 
sages) as they pass through. Thus a firewall at the gateway cannot filter traffic 
by its content but merely by its address information. 

3. The use of passwords protects data (and therefore information as well). The 
use of encryption protects information. 

4. In the case of a public-key encryption system, knowing how messages are 
encrypted does not allow messages to be decrypted. 

5. The problems are international in nature and therefore not subject to the laws 
of a single government. Moreover, legal remedies merely provide recourse to 
injured parties rather than preventing the injuries. 

Chapter 5 

Section 5.1 

). A process is the activity of executing an algorithm. A program is a representa- 
tion of an algorithm. 

2. in the introductory chapter we cited algorithms for playing music, operating 
washing machines, constructing models, and performing magic tricks, as well 
as the Euclidean algorithm. Many of the "algorithms" you meet in everyday 
life fail to be algorithms according to our formal definition. The example of 
the long-division algorithm was cited in the text. Another is the algorithm exe- 
cuted by a clock that continues to advance its hands and ring its chimes day 
after day. 

3. The informal definition fails to require that the steps be ordered and unam- 
biguous. It merely hints at the requirements that the steps be executable and 
lead to an end. 
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4. There are two points here. The first is that the instructions define a nontermi- 
nating process. In reality, however, the process will ultimately reach the state 
in which there are no coins in your pocket. In fact, this might be the starting 
state. At this point the problem is that of ambiguity. The algorithm, as repre- 
sented, does not tell us what to do in this situation. 


Section 5.2 

1. One example is found in the composition of matter. At one level, the primi- 
tives are considered molecules, yet these particles are actually composites 
made up of atoms, which in turn are composed of electrons, protons, and 
neutrons. Today, we know that even these "primitives" are composites, 

2. Once a procedure is correctly constructed, it can be used as a building block 
for larger program structures without reconsidering the procedure's internal 
composition. 

3. X <- the larger input; 

Y <- the smaller input; 
while (Y not zero) do 

(Remainder <- remainder after dividing X by Y; 

X<— Y; 

Y <— Remainder); 

CCD <r- X 

4. All other colors of light can be produced by combining red, blue, and green. 
Thus a television picture tube is designed to produce these three basic 
colors. 

Section 5.3 

1. a. if (n = 1 or n = 2} 

then (the answer is the list containing the single value n) 
else (Divide n by 3, obtaining a quotient q and a remainder r. 
if (r = 0) 

then (the answer is the iist containing q 3s) 
if (r = 1) 

then (the answer is the list containing (q - 1) 3s and two 2s;) 
if (r = 2) 

then (the answer is the list containing q 3s and one 2) 

) 

b. The result would be the list containing 667 threes. 

c. You probably experimented with small input values until you began to see 
a pattern. 

2. a. Yes. Hint; Place the first tile in the center so that it avoids the quadrant 

containing the hole while covering one square from each of the other 
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quadrants. Each quadrant then represents a smaller version of the original 
problem. 

b. The board with a single hole contains 2 2 " - 1 squares, and each tile covers 
exactly three squares. 

c. Parts (a) and (b) of this question provide an excellent example of how 
knowing a solution to one problem helps solve another. See Polya's fourth 
phase. 

3. It says, "This is the correct answer." 

4. Simply trying to assemble the pieces would be a bottom-up approach. 

However, by looking at the puzzle box to see what the picture is supposed to 

look like adds a top-down component to your approach. 


Section 5 . 4 


1 . Change the test in the while statement to read "target value not equal to cur- 
rent entry and there remain entries to be considered." 

2. Z e- 0; 

X e- 1 ; 

repeat (Z <- Z + X; 

X <- X + 1) 
until (X = 6) 

3= This has proven to be a problem with the C language. When the do and while 
key words are separated by several lines, readers of a program often stumble 
over the proper interpretation of a while clause. In particular, the while at the 
end of a do statement is often interpreted as the beginning of a while state- 
ment. Thus experience would say that it is better to use different key words to 
represent pretest and posttest loop stuctures. 


4. Cheryl 
Gene 
Alice 
Brenda 


Alice Alice 

Cheryl Brenda 

Gene Cheryl 

Brenda Gene 


5 It is a waste of time to insist on placing the pivot above an identical entry in 
the list. For instance, make the proposed change and then try the new pro- 
gram on a list in which all entries are the same. 

6. procedure sort (List) 

N 4 - 1; 

while (N is less than the length of List) do 
(J <r- N + 1 ; 

while (J is not greater than length of List) do 

(if (the entry in position J is less than the entry in position N) 
then (interchange the two entries) 

J « - J + 1 ) 

N <- N + 1) 
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7. The following is an inefficient solution. Can you make it more efficient? 

procedure sort (List) 

N f-the length of List; 
while (N is greater than 1) do 
(j <_ the length of List; 
while 0 is greater than 1) do 

(if (the entry in position J is less than the entry in position J - 1) 
then (interchange the two entries) 

J «- J- 1) 

N <r- N - 1 ) 

Section 5.5 

1 . The first name considered would be Henry, the next would he Larry, and the 
last would be Joe. 

2. 8, 17 

3. 1,2, 3, 3, 2, 1 

4. The termination condition is "N is bigger than or equal to 3" (or "N is not 
less than 3"). This is the condition under which no additional activations 
are created. 

Section 5.6 

1 . If the machine can sort 100 names in one second, it can perform % (10,000 - 
100) comparisons in one second. This means that each comparison takes 
approximately 0.0004 second. Consequently, sorting 1000 names [which 
requires an average of 7, (1,000,000 - 1000) comparisons] requires roughly 100 
seconds or IVa minutes. 

2. The binary search belongs to ©fig « ) , the sequential search belongs to 0(n) , 
and the insertion sort belongs to 0(n 2 ). 

3. The class 0(lg n) is most efficient, followed by 0(n), Q(n 2 ), and 0(n 3 ). 

4. No. The answer is not correct, although it might sound right. The truth is that 
two of the three cards are the same on both sides. Thus the probability of 
picking such a card is two-thirds. 

5. No. If the dividend is less than the divisor, such as in 7?, the answer given is 1, 
although it should be 0. 

6 . No. If the value ofX is zero and the value ofY is nonzero, the answer given 
will not be correct. 

7. Each time the test for termination is conducted, the statement "Sum = 1+2 
+ ... + K and Xless than or equal to N" is true. Combining this with the termi- 
nation condition "K greater than or equal to N" produces the desired conclu- 
sion "Sum = 1 + 2 + ... + TV. " Because K is initialized at zero and incremented 
by one each time through the loop, its value must ultimately reach that of AT. 
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8. Unfortunately, no. Problems beyond the control of hardware and software 
design, such as mechanical malfunctions and electrical problems, can affect 
computations. 

Chapter 6 

Section 6.1 

1 . A program in a third-generation language is machine independent in the 
sense that its steps are not stated in terms of the machine's attributes such as 
registers and memory cell addresses. On the other hand, it is machine 
dependent in the sense that arithmetic overflow and truncation errors will 
still occur. 

2. The major distinction is that an assembler translates each instruction in the 
source program into a single machine instruction, whereas a compiler often 
produces many machine-language instructions to obtain the equivalent of a 
single source program instruction. 

3. The declarative paradigm is based on developing a description of the problem 
to be solved. The functional paradigm forces the programmer to describe 

the problem's solution in terms of solutions to smaller problems. The object- 
oriented paradigm places emphasis on describing the components in the 
problem's environment. 

4. The third-generation languages allow the program to be expressed more in 
terms of the problem's environment and less in terms of computer gibberish 
than do the earlier-generation languages. 

Section 6.2 

1 . Using a descriptive constant can improve the accessibility of the program. 

2. A declarative statement describes terminology; an imperative statement 
describes steps in an algorithm. 

3. integer, real, character, and Boolean. 

4. The if-then-else and while loop structures are very common. 

5. All components of a homogeneous array have the same type. 

Section 6.3 

1. A local variable is accessible only within a program unit such as a procedure; 
a global variable is accessible program wide. 

2. A function is a procedure that returns a value associated with the function's 
name. 

3. Because that is what they are. I/O operations are actually calls to routines 
within the machine's operating system. 
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4 . A formal parameter is an identifier within a procedure. It serves as a place- 
holder for the value, the actual parameter, that is passed to the procedure 
when the procedure is called. 

5. A procedure is designed to perform an action, whereas a function is designed 
to produce a value. Thus the program is more readable if the name of a proce- 
dure reflects the action it performs and the name of a function reflects the 
value it returns. 

Section 6.4 

1. Lexical analysis: the process of identifying tokens. 

Parsing: the process of recognizing the grammatical structure of the program. 
Code generation: the process of producing the instructions in the object program. 

2. A symbol table is the record of information the parser has obtained from the 
program's declarative statements. 



z 


4. They are one or more instances, of the substrings 
forward backward cha cha cha 
backward forward cha cha cha 
swing right cha cha cha 
swing left cha cha cha 

Section 6.5 

1 . A class is the description of an object. 

2. One would probably be MeteorClass from which the various meteors would be 
constructed. Within the class LaserClass one might find an instance variable 
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named AimDirection indicating the direction in which the laser is aimed. This 
variable would probably be used by the fire, turnRight, and turnLeft methods. 

3. The Employee class might contain features relating to an employee's name, 
address, years in service, etc. The Ful 1 Time Employee class might contain 
features relating to retirement benefits. The PartTimeEmployee class might 
contain features relating to hours worked per week, hourly wage, etc. 

A. A constructor is a special method in a class that is executed when an instance 
of the class is created. 

5. Some items in a class are designated as private to keep other program units 
from gaining direct access to those items. If an item is private, then the reper- 
cussions of modifying that item should be restricted to the interior of the class. 

Section 6.6 

1 . The list would include techniques for initiating the execution of concurrent 
processes and techniques for implementing interprocess communication. 

2. One is to place the burden on the processes, another is to place the burden on 
the data. The latter has the advantage of concentrating the task at a single 
point in the program. 

3. These include weather forecasting, air traffic control, simulation of complex 
systems (from nuclear reactions to pedestrian traffic), computer networking, 
and database maintenance. 

Section 6.7 

1 . R, T, and V. For instance, we can show that R is a consequence by adding its 
negation to the collection and showing that resolution can lead to the empty 
statement, as shown here: 



s or v 


! II V 


empty 


2 No. The collection is inconsistent, because resolution can lead to the empty 
statement, as shown here: 




R OR - P 


■R 


POR R 



empty 
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3. a. thrif tier f sue , carol) 

thriftierfsue, John) 

b. thriftierfsue, carol) 
thriftier (bill, carol) 

c. thriftier (carol, John) 
thrif tier (bill , sue) 
thr i f t iert sue , carol) 
thrift ier (bill , carol) 
thrift ier (bill , John) 
thriftierfsue, John) 

4. mother(X, Y) parent(X, Y) , female(X). 

father(X, Y) parent(X, Y), male(X). 

Chapter 7 

Section 7.1 

1 . A long sequence of assignment statements is not as complex in the context of 
program design as a few nested if statements. 

2. How about the number of errors found after a fixed period of use? One prob- 
lem here is that this value cannot be measured in advance, 

3. The point here is to think about how software properties can be measured. 
One approach for estimating the number of errors in a piece of software is to 
intentionally place some errors in the software when it is designed. Then, 
after the software has supposedly been debugged, check to see how many of 
the original errors are still present. For example, if you intentionally place 
seven errors in the software and find that five have been removed after 
debugging, then you might conjecture that only '°h of the total errors in the 
software have been removed. 

4. (me would be education. Humans were successfully teaching each other long 
before researchers began to try to understand how humans learn. Thus, edu- 
cation was dominated by practitioners and the techniques they had devel- 
oped. Today, many would argue that the theoreticians have merely messed 
things up. 

Section 7.2 

1 . System requirements are stated in terms of the application environment, 
whereas the specifications are stated in technical terms and identify how the 
requirements will be met. 

2. The analysis phase concentrates on what the proposed system must accom- 
plish. The design phase concentrates on how the system accomplishes its 
goals. The implementation phase concentrates on the actual construction of 
the system. The testing phase concentrates on making sure that the system 
does what it is intended to do. 
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3 . A software requirements document is a written agreement between a client 
and a software engineering firm stating the requirements and specifications 
of the software to be developed. 

Section 7.3 

1 . The traditional waterfall approach dictates that the analysis, design, imple- 
mentation, and testing phases be performed in a linear manner. The proto- 
typing model allows for a more relaxed trial -and- error approach. 

2. Traditional evolutionary prototyping is performed within the organization 
developing the software, whereas open-source development is not restricted 
to an organization. In the case of open-source development the person over- 
seeing the development does not necessarily determine what enhancements 
will be reported, whereas in the case of traditional evolutionary prototyping 
the person managing the software development assigns personnel to specific 
enhancement tasks. 

3. This is one for you to think about. If you were an administrator in a software 
development company, would you be able to adopt the open-source method- 
ology for the development of software to be sold by your company? 

Section 7.4 

1 . The chapters of a novel build on one another, whereas the sections in an 
encyclopedia are largely independent. Hence a novel has more coupling 
between its chapters than an encyclopedia has between its sections. However, 
the sections within an encyclopedia probably have a higher level of cohesion 
than the chapters in a novel. 

2. The accumulated score would be an example of data coupling. Other "couplings" 
that might exist would include fatigue, momentum, knowledge gained about an 
opponent's strategy, and perhaps self-confidence. In many sports the cohesion 
of the units is increased by terminating the action and restarting the next unit 
from a fresh beginning. For example, in baseball each inning starts without any 
base runners, even though the team might have finished the previous inning 
with the bases loaded. In other cases the units are scored separately as in tennis 
where each set is won or lost without regard for the other sets. 

3. This is a tough one. From one point of view, we could start by placing every- 
thing in a single module. This would result in little cohesion and no coupling 
at all. If we then begin to divide this single module into smaller ones, the 
result would be an increase in coupling. We might therefore conclude that 
increasing cohesion tends to increase coupling. 

On the other hand, suppose the problem at hand naturally divides into three 
very cohesive modules, which we will call A, B, and C. If our original design 
did not observe this natural division (for example, half of task A might be 
placed with half of task B, and so on), we would expect the cohesion to be low 
and the coupling high. In this case, redesigning the system by isolating tasks 
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A, B, and C into separate modules would most likely decrease intermodule 
coupling as intramodule cohesion increases. 

4. You should probably add an arrow indicating that ControlGairie must tell 
UpdateScore who won the volley and another arrow in the other direction 
indicating that UpdateScore will report the current status (such as "set over" 
or "match over") when it returns control to ControlGame. 

5. Arrows would be added indicating control passing from Judge to Flayer A 
and back to Judge before Judge passes control to Score. 

6. A traditional programmer writes programs in terms of statements such as 
those introduced in Chapter 6 . A component assembler builds programs by 
linking prefabricated blocks called components. 


Section 7.5 


1 . Make sure that your diagram deals with the flow of data (not the movement of 
books). The diagram below indicates that book identifications (from patrons) 
and patron records (from the library files) are combined to form loan records 


that are stored in the library files. 


Patron 


book id. 


Process 

Loan 



3n r e W 1 



3. 



Patron 




[librarian 
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4. The relationship is a many-to-many relationship so the diagram should look 
like this: 


stays in 

Guest - Hotel 

< 

hosts 

5. Design patterns provide standardized, well-developed approaches for imple- 
menting recurring software themes. 

Section 7.6 

1. The purpose of testing software is to find errors. In a sense, then, a test that 
does not reveal an error is a failure. 

2 One would be to consider the amount ofbranching in the modules. For 
instance, a procedural module containing numerous loops and if-then- 
e 1 s e statements would probably be more prone to errors than a module with 
a simple logical structure. 

3. Boundary value analysis would suggest that you test the software on a list 
with 100 entries as well as a list with no entries. You might also perform a test 
with a list that is already in the correct order. 

Section 7.7 

1 . Documentation takes the form of user documentation, system documenta- 
tion, and technical documentation. It might appear in accompanying manu- 
als, within the source program in the form of comments and well-written 
code, through interactive messages that the program itself writes at a termi- 
nal, through data dictionaries, and in the form of design documents such as 
structure charts, class diagrams, dataflow diagrams, and entity-relationship 
diagrams. 

2. In both the development and modification phases. The point is that modifi- 
cations must be documented as thoroughly as the original program. (It is 
also true that software is documented while in its use phase. For example, 

a user of the system might discover problems, which, rather than being 
fixed, are merely reported in future editions of the system user's man- 
ual. Moreover, books documenting the use of software are sometimes 
written after the software has been in use for some time and has gained 
popularity.) 

3. Different people will have different opinions on this one. Some will argue that 
the program is the point of the whole project and thus is naturally the more 
important. Others will argue that a program is worth nothing if it is not docu- 
mented, because if you cannot understand a program, you cannot use it or 
modify it. Moreover, with good documentation, the task of creating the pro- 
gram can be "easily" re-created. 
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Section 7.8 

1 - Courts have at times interpreted substantial similarity quite broadly, consider- 
ing similarities far beyond those of the literal components of a program. The 
"nonliteral" components that have been considered include such things as pro- 
gram structure, design records, and the look and feel produced by the software. 

2. Copyright and patent laws benefit society because they encourage creators of 
new products to make them available to the public. Trade secret laws benefit 
society because they allow a company to protect the steps in a product's 
development from competitors. Without such protection, companies would 
hesitate to make major investments in new products. 

3. A disclaimer does not protect a company against negligence. 

Chapter 8 

Section 8.1 

1 . List: A listing of the members of a sports team. 

Stack: The stack of trays in a cafeteria. 

Queue: The line at a cafeteria. 

Tree: The organization chart of many governments. 

2. The leaf (or terminal) nodes are D and C. B must be the root node because all 
the other nodes have parents. 

3. if you were to write a program for playing a game of checkers, the data struc- 
ture representing the checkerboard would probably be a static structure 
because the size of the board does not change during the game. However, if 
you were to write a program for playing a game of dominoes, the data struc- 
ture representing the pattern of dominoes constructed on the table would 
probably be a dynamic structure because this pattern varies in size and can- 
not be predetermined. 

4. A telephone directory is essentially a collection of pointers (telephone num- 
bers) to people. The clues left at the scene of a crime are (perhaps encrypted) 
pointers to the perpetrator. 


Section 8.2 

1. 5 37428 1 96 

2. if j ? is the number of rows in the matrix, the formula is R(J- 1 ) + ( 7 - 1 ). 

3. (c x i) + j 

4. The head pointer contains the NIL value. 

5. Last <- the last name to be printed 
Finished «- false 

Current Pointer «- the head pointer; 

while (Current Pointer not NIL and Finished = false) do 
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(print the entry pointed to by Current Pointer, 
if (the name just printed = Last) 
then (Finished <- true) 

Current Pointer <- the value in the pointer 
cell in the entry pointed to by Current Pointer) 

6. The stack pointer points to the ceil immediately below the base of the stack. 

7. Represent the stack as a one-dimensional array and the stack pointer as a 
variable of integer type. Then use this stack pointer to maintain a record of 
the position of the stack’s top within the array rather than of the exact mem- 
ory address. 

8. Both empty and full conditions are indicated by the equal head and tail 
pointers. Thus additional information is required to distinguish between 
the two conditions. 

9. 

Root pointer 



Section 8.3 
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3. 


procedure PrintTreelTree) 

if [root pointer of Tree is not NIL) 
then (Apply the procedure PrintTree to the 

tree that appears as the left branch 
in Tree: 

Print roo I node ofTree; 

Apply the procedure PrintTree to the tree 

that appears 35 the right branch in Tree.) 


:n 


procedure PrintTreelTree) 

if [root pointer of Tree is not MIL} 
then (Apply the procedure PrintTree to the 

tree that appears as the left branch 
in Tree; 

Print root node ofTree; 

Apply the procedure PrintTree to the tree 

that appears as the right branch in Tree.) 


Here, when K 
IS printed 


y 


4. At each node, each child pointer could be used to represent a unique letter in 
the alphabet. A word could be represented by a path down the tree along the 
sequence of pointers representing the spelling of the word. Anode could be 
marked in a special way if it represented the end of a correctly spelled word. 


Section 8.4 

1 . A type is a template; an instance of that type is an actual entity built from 
that template. As an analogy, dog is a type of animal, whereas Lassie and Rex 
are instances of that type. 

2. A user-defined data type is a description of data organization, whereas an 
abstract data type includes operations for manipulating the data. 

3. A point to be made here is that you have a choice between implementing the 
list as a contiguous list or a linked list. The choice you make will affect the 
structure of the procedures for inserting new entries, deleting old ones, and 
finding entries of interest. However, this choice should not be visible to a user 
of an instance of the abstract data type. 

4. The abstract data type would at least contain a description of a data structure 
for storing the account balance and procedures for making a deposit and mak- 
ing a withdrawal via a check. 


Section 8.5 

1 . Both abstract data types and classes are templates for constructing instances 
of a type. Classes, however, are more general in that they are associated with 
inheritance and might describe a collection of only procedures. 


2. A class is a template from which objects are constructed. 

3. The Class might contain a circular queue along with procedures for adding 
entries, removing entries, testing to see if the queue is full, and testing to see 
if the queue is empty. 

Section 8.6 

1. a. A5 b. A5 c. CA 

2. D50F, 2EFF, 5FFE 

3. 2EA0, 2FB0, 2101, 20B5, D50E, E50F, 5EE1, 5FF1, BF14, BOOS, COOO 

4. When traversing a linked list in which each entry consists of two memory 
cells (a data cell followed by a pointer to the next entry), an instruction of the 
form DROS could be used to retrieve the data and DR1S could be used to 
retrieve the pointer to the next entry. If the form DRTS were used, then the 
exact memory cell being referenced could be adjusted by modifying the value 
in register T. 


Chapter 9 

Section 9.1 

1 . The purchasing department would be interested in inventory records to place 
orders for more raw goods, whereas the accounting department would need 
the information to balance the books. 

2. A database model provides an organizational perspective of a database that is 
more compatible with applications than the actual organization. Thus defin- 
ing a database model is the first step toward allowing the database to be used 
as an abstract tool. 

3. The application software translates the users requests from the terminology 
of the application into terminology compatible with the database model that 
is supported by the database management system. The database management 
system in turn converts these requests into actions on the actual database. 

Section 9.2 

1 . a. G. Jerry Smith 

b. Cheryl H. Clark 

c. S26Z 

2. One solution is 

TEMP <- SELECT from 1 OB 

where Dept = "PERSONNEL" 

LIST <- PROJECT JobTitle from TEMP 

In some systems this results in a list with a job title repeated, depending on 
how many times it occurred in the personnel department. That is, our list 
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might contain numerous occurrences of the title secretary. It is more com- 
mon, however, to design the PROJECT operation so that it removes duplicate 
tuples from the resulting relation. 

3. One solution is 

TEMPI <— JOIN JOB and ASSIGNMENT 

where JOB.Jobld = ASSIGNMENT A bid 
TEMP2 «- SELECT from TEMPI 

where TermDate = " i " 

TEMP3 <r- JOIN EMPLOYEE and TEMP2 

where EMPLOYEE. Emplld = TEMP2.Emplld 
RESULT <- PROJECT Name, Dept from TEMP3 

4. select JobTitle 

from JOB 

where Dept = "PERSONNEL" 

select EMPLOYEE. Name, JOB. Dept 

from JOB, ASSIGNMENT, and EMPLOYEE 
where (jobjob = ASSIGNMENT.Jobld) and 

(ASSIGNMENT, Emplld = EMPLOYEE. EmpilD) 
and (ASSIGNMENT. Term Date = "*") 

5. The model itself does not provide data independence. This is a property of the 
data management system. Data independence is achieved by providing the data 
management system the ability to present a consistent relational organization 
to the application software even though the actual organization might change. 

6. Through common attributes. For instance, the EMPLOYEE relation in this sec- 
tion is tied to the ASSIGNMENT relation via the attribute Emplld, and the 
ASSIGNMENT relation is tied to the JOB relation by the attribute Jobld. 
Attributes used to connect relations like this are sometimes called connection 
attributes. 

Section 9.3 

1 . There might be methods for assigning and retrieving the StartDate as well 
as the TermDate. Another method might be provided for reporting the total 
time in service. 

2. A persistent object is an object that is stored indefinitely. 

3. One approach is to establish an object for each type of product in inventory. 
Each of these objects could maintain the total inventory of its product, the 
cost of the product, and links to the outstanding orders for the product. 

4. As indicated at the beginning of this section, object-oriented databases appear 
to handle composite data types more easily than relational databases. 
Moreover, the fact that objects can contain methods that take an active role in 
answering questions promises to give object-oriented databases an advantage 
over relational databases whose relations merely hold the data. 
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Section 9.4 

1 . Once a transaction has reached its commit point, the database management 
system accepts the responsibility of seeing that the complete transaction is 
performed on the database. A transaction that has not reached its commit 
point does not have such assurance. If problems arise, it might have to be 
resubmitted. 

2. One approach would be to stop interweaving transactions for an instant so 
that all current transactions can be completed in full. This would establish a 
point at which a future cascading rollback would terminate. 

3. A balance of $100 would result if the transactions were executed one at a 
time. A balance of $200 would result if the first transaction were executed 
after the second transaction retrieved the original balance and before that sec- 
ond transaction stored its new balance. A balance of $300 would result if the 
second transaction were executed after the first retrieved the original balance 
and before the first transaction stored its new balance. 

4. a. Jfno other transaction has exclusive access, the shared access will be granted, 
b. If another transaction already has some form of access, the database man- 
agement system will normally make the new transaction wait, or it could 
roll back the other transactions and give access to the new transaction. 

5. Deadlock would occur if each of two transactions acquired exclusive access to 
different items and then required access to the other. 

6 . The deadlock above could be removed by rolling back one of the transactions 
(using the log) and giving the other transaction access to the data item previ- 
ously held by the first. 

Section 9.5 

1. You should be led through these initial stages; 
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2. The idea is to first divide the file to be stored into many separate files contain- 
ing one record each. Next, group the one-record files into pairs, and apply the 
merge algorithm to each pair. This results in half as many files, each with two 
records. Furthermore, each of these two-record files is sorted. We can group 
them into pairs and again apply the merge algorithm to the pairs. Again we 
find ourselves with fewer but larger files, each of which is sorted. Continuing 
in this fashion, we are ultimately left with only one file that consists of all the 
original records but in sorted order. (If an odd number of files occurs at any 
stage of this process, we need merely to set the odd one aside and pair it with 
one of the larger files in the next stage.) 

3. If the file is stored on tape or CD, its physical organization is most likely 
sequential. However, if the file is stored on magnetic disk, then it is most likely 
scattered over various sectors on the disk and the sequential nature of the file 
is a conceptual property that is supported by a pointer system or some form of 
a list in which the sectors on which the file is stored are recorded. 

4 First find the target key in the file's index. There obtain the location of the tar- 
get record. Then retrieve the record at that location. 

5 A poorly chosen hash algorithm results in more clustering than normal and 
thus in more overflow. Because the overflow from each section of mass stor- 
age is organized as a linked list, searching through the overflow records is 
essentially searching a sequential file. 

6. The section assignments are as follows: 

a. 0 b. 0 c. 3 d. 0 e. 3 

f. 3 g. 3 h. 3 i. 3 j . 0 

Thus all the records hash into buckets 0 and 3, leaving buckets 1, 2, 4, and 5 
empty. The problem here is that the number ofbuckets being used (6) and 
the key values have the common factor of 3. (You might try rehashing these 
key values using 7 buckets and see what improvement you find.) 

7. The point here is that we are essentially applying a hash algorithm to place 
the people in the group into one of 365 categories. The hash algorithm, of 
course, is the calculation of one's birthday. The amazing thing is that only 23 
people are required before the probability is in favor of at least two of the 
birthdays being the same. In terms of a hashed file, this indicates that when 
hashing records into 365 available buckets of mass storage, clustering is likely 
to be present after only 23 records have been entered. 


Section 9.6 

1 . Searching for patterns in dynamic data is problematic. 

2. Class description-Identify characteristics of subscribers to a certain magazine. 
Class discrimination-Identify features that distinguish between subscribers 

of two magazines. 
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Cluster analysis-Identify magazines that tend to attract similar subscribers. 
Association analysis-Identify links between subscribers to various magazines 
and different purchasing habits. 

Outlier analysis-Identify subscribers to a magazine who do not conform to 
the profile of normal subscribers. 

Sequential pattern analysis-Identify trends in magazine subscription. 

3. The data cube might allow sales data to be viewed as sales by month, sales by 
geographic region, sales by product class, etc. 

4. Traditional database inquiries retrieve facts stored in the database. Data 
mining looks for patterns among the facts. 

Section 9.7 

1. The point here is to compare your answer to this question with that of the 
next. The two raise essentially the same question but in different contexts. 

2. See previous problem. 

3. You might receive announcements or advertisements for opportunities that 
you would not have otherwise received, but you might also become the sub- 
ject of solicitation or the target of crime. 

4. The point here is that a free press can alert the public to abuses or potential 
abuses and thus bring public opinion into play. In most of the cases cited in the 
text, it was a free press that initiated corrective action by alerting the public. 


Chapter 10 

Section 10.1 

1 . Those introduced in the chapter include reflex actions, actions based on real- 
world knowledge, goal seeking actions, learning, and perception. 

2. Our purpose here is not to give a decisive answer to this issue but to use it to 
show how delicate the argument over the existence of intelligence really is. 

3. Although most of us would probably say no, we would probably claim that if a 
human dispensed the same products in a similar atmosphere, awareness 
would be present even though we might not be able to explain the distinction. 

4. There is not a right or wrong answer. Most would agree that the machine at 
least appears to be intelligent. 

Section 70.2 

1 . In the remote control case, the system needs only to relay the picture, 

whereas to use the picture for maneuvering, the robot must be able to "under- 
stand" the meaning of the picture. 
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2. The possible interpretations for one section of the drawing do not match any 
of those of another section. To embed this insight into a program, you might 
isolate the interpretations allowable for various line junctions and then write 
a program that tries to find a set of compatible interpretations (one for each 
junction). In fact, if you stop and think about it, this is probably what your 
own senses did in trying to evaluate the drawing. Did you detect your eyes 
scanning back and forth between the two ends of the drawing as your senses 
tried to piece possible interpretations together? (If this subject interests you, 
you will want to read about the work of people such as D. A. Huffman, M. B. 
Clowes, and D. Waltz.) 

3 There are four blocks in the stack but only three are visible. The point is that 
understanding this apparently simple concept requires a significant amount 
of "intelligence." 

4. Interesting, isn't it? Such subtle distinctions in meaning present significant 
problems in the field of natural language understanding. 

5 Is the sentence describing what kind of horses they are, or is it telling what 
some people are doing? 

6 . The parsing process produces identical structures, but the semantic analysis 
recognizes that the prepositional phrase in the first sentence tells where the 
fence was built, whereas the phrase in the second sentence tells when the 
fence was built. 

7. They are brother and sister. 


Section 10.3 

1 . Production systems provide a uniform approach to a variety of problems. 

That is, although apparently different in their original form, all problems 
reformulated into terms of production systems become the problem of finding 
a path through a state graph. 
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3. The tree is four moves deep. The upper portion appears as follows: 
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4. The task requires too much paper as well as too much time. 

5 Our heuristic system for solving the eight-puzzle is based on an analysis of 
the immediate situation, just as that of the mountain climber. This short- 
sightedness is what allowed our algorithm to proceed initially along the 
wrong path in the example of this section just as a mountain climber can be 
led into trouble by always plotting a course based only on the local terrain. 
(This analogy often causes heuristic systems based on local or immediate 
information to be called hill-climbing systems.) 

6 . The system rotates the 5, 6, and 8 tiles either clockwise or counterclockwise 
until the goal state is reached. 

7. The problem here is that our heuristic scheme ignores the value of keeping the 
hole adjacent to the tiles that are out of place. If the hole is surrounded by tiles in 
their correct position, some of these tiles must be moved before those tiles still 
seeking their correct place can be moved. Thus it is incorrect to consider all those 
tiles surrounding the hole as actually being correct. To fix this flaw, we might first 
observe that a tile in its correct position but blocking the hole from incorrectly 
positioned tiles must be moved away from its correct position and later moved 
back. Thus each correctly positioned tile on a path between the hole and the 
nearest incorrectly positioned tile accounts for at least two moves in the remain- 
ing solution. We can therefore modify our projected cost calculation as follows: 

First, calculate the projected cost as before. However, if the hole is totally iso- 
lated from the incorrectly positioned tiles, find a shortest path between the 
hole and an incorrectly positioned tile, multiply the number of tiles on this 
path by two, and add the resulting value to the previous projected cost. 

With this system, the leaf nodes in Figure 10.10 have projected costs of 6, 6, 
and 4 (from left to right), and thus the correct branch is pursued initially. 

Our new system is not foolproof. For example, consider the following configu- 
ration. The solution is to slide the 5 tile down, rotate the top two rows clock- 
wise until those tiles are correct, move the 5 tile back up, and finally move the 
8 tile to its correct position. However, our new heuristic system wants us to 
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start by moving the 8 tile, because the state obtained by this initial move has a 
projected cost of only 6 compared with the other options that have costs of 8. 


236 
1 54 
7 8 



236 

236 

236 

1 54 

1 4 

1 54 

78 

758 

78 

( 6 ) 

( 8 ) 

( 8 ) 


Section 10.4 

1 . Real-world knowledge is the information about the environment that a human 
uses to understand and reason. Developing methods for representing, storing, 
and recalling this information is a major goal of research in artificial intelligence. 

2. It uses the closed-world assumption. 

3. The frame problem is the problem of correctly updating a machine's store of 
knowledge as events occur. The task is complicated by the fact that many 
events have indirect consequences. 

4. Imitation, supervised training, and reinforcement. Reinforcement docs not 
involve direct human intervention. 

5. Evolutionary techniques do not train a single computer system. Instead, they 
involve multiple generations of systems. 

Section 10.5 

1 . All patterns produce an output of 0 except for the pattern 1,0, which pro- 
duces an output of 1 . 

2. Assign a weight of 1 to each input, and assign the unit a threshold value of 1.5. 

3. A major problem identified in the text is that the training process might oscil- 
late, repeating the same adjustments over and over. 

4. The network will wander to the configuration in which the center processing 
unit is excited and all others are inhibited. 

Section 10.6 

1 . Rather than developing a complete plan of action, the reactive approach is to 
wait and make decisions as options arise. 

2. The point here is for you to think about how broad the field of robotics is. It 
encompasses the entire scope of artificial intelligence as well as numerous 
topics in other fields. The goal is to develop truly autonomous machines that 
can move about and react intelligently with their environments. 

3. Internal control and physical structure. 
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Section 10.7 

1 . There is no right or wrong answer. 

2 . There is no right or wrong answer. 

3 . There is no right or wrong answer. 

Chapter 11 

Section 11.1 

1. H ow about the boolean operations AND, OR, and XOR. In fact, we used tables 
in Chapter 1 when introducing these functions. 

2 . The computation of a loan payment, the area of a circle, or a car's mileage. 

3 . Mathematicians call such functions transcendental functions. Examples 
include the logarithmic and trigonometric functions. These particular exam- 
ples can still be computed but not by algebraic means. For example, the 
trigonometric functions can be calculated by actually drawing the triangle 
involved, measuring its sides, and only then turning to the algebraic opera- 
tion of dividing. 

4. One example is the problem of trisecting an angle. That is, they were unable 
to construct an angle that was one-third the size of a given angle. The point is 
that the Greeks' straight-edge and compass computational system is another 
example of a system with limitations. 

Section 11.2 

1 . The result is the following diagram: 
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3. 
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4. The point here is that the concept of a Turing machine is supposed to capture 
the meaning of "to compute." That is, any time a situation occurs in which 
computing is taking place, the components and activities of a Turing machine 
should be present. For example, a person figuring income tax is doing a cer- 
tain degree of computing. The computing machine is the person and the tape 
is represented by the paper on which values are recorded. 

5 The machine described by the following table halts if started with an even 
input but never halts if started with an odd input: 
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Section 11.3 

1. clearAUX; 
incrAUX; 
while X not 0 do; 
clear X; 
clearAUX; 
end; 

while AUX not 0 do; 
incr X; 
clearAUX; 
end; 
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2. while X not 0 do; 

deer X ; 
end; 

3. copy X to AUX; 
while AUX not 0 do; 

51 

clear AUX; 
end; 

copy X to AUX; 

invert AUX; (See Question #1) 
while AUX not 0 do; 

52 

clear AUX; 
end; 

while X not 0 do; 
clear AUX; 
clear X; 
end; 

4. If we assume that X refers to the memory cell at address 40 and that each pro- 
gram segment starts at location 00, we have the following conversion table: 
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deer X; 
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5. Just as in a real machine, negative numbers could be dealt with via a coding 
system. For example, the rightmost bit in each string can be used as a sign but 
with the remaining bits used to represent the magnitude of the value. 

6. The function is multiplication by 2. 

Section 11.4 

1. Yes. In fact, this program halts regardless of the initial values of its variables, 
and therefore it must halt if its variables are initialized to the program’s 
encoded representation. 

2. The program halts only if the initial value ofX ends in a 1. Because the ASCII 
representation of a semicolon is 00111011, the encoded version of the program 
must end in a 1. Therefore the program is self- terminating. 

3. The point here is that the logic is the same as in our argument that the halt- 
ing problem does not have an algorithmic solution. If the house painter paints 
his or her own house, then he or she does not and vice versa. 

Section 11.5 

1. We could conclude only that the problem has complexity 8(2"). If we could 
show that the "best algorithm" for solving the problem belongs to 0(2"), we 
could conclude that the problem belongs to 0(2"). 

2. No. As a general rule, the algorithm in 0(n ) will outperform the one in 0(2"), 
but for small input values an exponential algorithm often outperforms a poly-' 
nomial algorithm. In fact, it is true that exponential algorithms are sometimes 
preferred to polynomial ones when the application involves only small inputs. 
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3. The point is that the number of subcommittees is growing exponentially, and 
from this point on, the job of listing all the possibilities becomes a laborious task. 

4 . Within the class of polynomial problems is the sorting problem, which can be 
solved by polynomial algorithms such as the insertion sort. 

Within the class of nonpolynomial problems is the task of listing all the sub- 
committees that could be formed from a given parent committee. 

Any polynomial problem is an NP problem. The Traveling Salesman problem 
is an example of an NP problem that has not been shown to be a polynomial 
problem. 

5. No. Our use of the term complexity refers to the time required to execute an 
algorithm-not to how hard the algorithm might be to understand. 

Section 11.6 

1. 211 X 313 = 66043 

2. The message 101 is the binary representation for 5. 5 K = 5 5 = 15625. 15625 
(mod 91) = 64, which is 1000000 in binary notation. Thus, 1000000 is the 
encrypted version of the message. 

3. The message 10 is the binary representation for 2. 2 d = 2 29 = 53 6 870912. 
536870912 (mod 91) = 32, which is 100000 in binary notation. Thus, 100000 is 
the decrypted version of the message. 

4 . n = A Xq=7X19= 133. To find d we need a positive integer value k such 
that k(p - l)(q - 1) + 1 = k(6 X 18) + 1 = 108Jt + 1 is evenly divisible by 

e = 5. The values k — 1 and k - 2 are not satisfactory, but k = 3 produces 
108k + 1 = 325, which is divisible by 5. The quotient 65 is the value of d. 
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